JP7272831B2 - Portable terminal device, information processing method and information processing program - Google Patents

Description

The present invention relates to a mobile terminal device, an information processing method and an information processing program.

A mobile terminal device equipped with a touch sensor is used. In recent years, some mobile terminal devices have a touch sensor on the rear side of the housing in addition to the touch sensor provided superimposed on the display provided on the front side of the housing (see, for example, Patent Document 1). .

JP 2015-188137 A

When the user holds the mobile terminal device with one hand and operates the touch sensor provided on the back surface, the operating finger is tilted (from an oblique direction) and touches the touch sensor. Therefore, a deviation may occur between the direction of the slide operation intended by the user and the direction in which the finger actually moves on the touch sensor. Further, when a finger is moved so as to slide on the touch sensor, a stick-slip phenomenon occurs due to friction between the touch sensor and the finger. The stick-slip phenomenon can also cause the finger to move on the touch sensor in a direction different from the user's intention.

One aspect of the disclosed technology is to provide a mobile terminal device capable of suppressing a deviation between a direction in which a finger is moved on a touch sensor provided on the back surface of a housing and an operation direction intended by a user. aim.

One aspect of the disclosed technology is exemplified by the following mobile terminal device. The mobile terminal device includes a housing having a display unit, a sensor provided on the rear surface of the housing on which the display unit is provided and detecting an operation by a finger, and a slide operation from a position where the sensor is touched. a control unit that scrolls the display of the display unit in the direction in which the The operation is detected as a slide operation in the first direction.

This portable terminal device can suppress the deviation between the finger movement direction on the touch sensor and the user's intended operation direction.

FIG. 1 is a diagram illustrating a combination of an appearance seen from one side and an appearance seen from the other side of a mobile terminal device according to an embodiment. FIG. 2 is a hardware configuration diagram of the mobile terminal device according to the embodiment. FIG. 3 is a plan view illustrating a detection surface of a sensor included in the mobile terminal device according to the embodiment; FIG. 4 is a diagram schematically showing a region where the sensor input analysis unit detects an operation by a user's finger on the detection surface of the sensor. FIG. 5 is a first diagram for comparing the trajectory of a finger operating a sensor provided on the back surface of the mobile terminal device according to the embodiment and the input value received by the sensor input analysis unit. FIG. 6 is a second diagram comparing the trajectory of a finger operating the sensor provided on the back surface of the mobile terminal device according to the embodiment and the input value received by the sensor input analysis unit. 7 is a diagram illustrating an example of a processing flow of the mobile terminal device according to the embodiment; FIG. FIG. 8 is a diagram showing an example of a screen scrolled by the processing flow of FIG. FIG. 9 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the first modification. FIG. 10 is a diagram illustrating an example of a processing flow of the mobile terminal device according to the first modification; FIG. 11 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the second modification. FIG. 12 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the third modification. FIG. 13 is a diagram schematically illustrating a situation in which a sensor provided on the back surface of the mobile terminal device is operated with a finger. FIG. 14 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the fourth modification. FIG. 15 is a diagram illustrating an example of a processing flow of a mobile terminal device according to a fifth modification; FIG. 16 is a diagram schematically showing a region where the control unit detects an operation with a user's finger on the detection surface of the sensor according to the sixth modification. FIG. 17 is a diagram illustrating the trajectory of a finger that repeatedly moves and stops on the detection surface of the sensor due to the stick-slip phenomenon.

Embodiments will be described below with reference to the drawings. The configuration of the embodiment shown below is an example, and the disclosed technology is not limited to the configuration of the embodiment.

<Embodiment>
A mobile terminal device according to an embodiment includes a housing having a display unit, a sensor provided on the back surface of the housing on which the display unit is provided and detecting an operation by a finger, and a position where the sensor is touched. and a control unit for scrolling the display of the display unit in the direction in which the slide operation is performed from the display unit. The mobile terminal device is, for example, a portable electronic device called a mobile phone, a smart phone, or a personal digital assistant that can be held with one hand.

Then, the control unit detects a slide operation to a first area having a first angle range starting from the touched position on the sensor as a slide operation in the first direction. Since the first area has the first angle range, even if the trajectory of the sliding finger on the sensor is slightly deviated from the first direction, the control unit can recognize the slide operation in the first direction as intended by the user. can enhance sexuality.

The control unit may discard a slide operation to a third area interposed between the first area and a second area that detects a slide operation in a second direction different from the first direction. . Even if the finger moved on the sensor with the intention of moving in the first direction by the user moves out of the first area, the slide operation to the area between the first area and the second area is discarded. A sudden detection as a slide operation in the second direction is suppressed. In addition, since the control unit does not detect the slide operation, scrolling and the like of the display unit are stopped. Therefore, the control section can make the user recognize that the finger has come off the first area or the second area.

The control unit controls a slide operation to a fourth area interposed between the first area and a second area for detecting a slide operation in a second direction different from the first direction. and the sliding operation in the third direction, which is an intermediate direction between the second direction and the second direction. By adopting such a configuration, the screen displayed on the display unit 19 can be scrolled in the third direction.

The first direction is an upward direction or a downward direction, and the control unit detects a slide operation in a fourth direction orthogonal to the first direction. A second angular range that is wider than the angular range may be defined. When the portable terminal device is gripped with one hand and the finger of the gripped hand is used to perform a sliding operation on the sensor, it is considered that the sliding operation in the horizontal direction is more difficult than in the vertical direction. By adopting such a configuration, the control unit can facilitate the slide operation by moving the finger in the left-right direction, which is difficult to move.

The sensor is provided at a position where a finger of one hand gripping the housing reaches the sensor from the diagonally downward direction, and the position of the first region is based on the movable range of the finger reaching the sensor from the diagonally downward direction. may be determined by When the mobile terminal device is held with one hand, the finger that performs the sliding operation on the sensor does not have a uniform movable range in all directions of up, down, left, and right with respect to the sensor. By determining the first region based on the movable range of the finger, it is possible to facilitate the sliding operation on the sensor.

The control unit may expand the first area to an angle range wider than the first angle range when the slide operation to the first area is detected. It is conceivable that the slide operation is continuously performed in the same direction. By enlarging the first area when a slide operation to the first area is detected, it becomes easy to continue the slide operation in the first direction.

The technology described above can also be grasped as an information processing method and an information processing program.

Embodiments will be further described below with reference to the drawings. FIG. 1 illustrates the appearance of the mobile terminal device according to the embodiment as seen from one side (front side appearance) and the other side (rear side appearance). In FIG. 1, the front side and the back side of the mobile terminal device 10 are alternately arranged as indicated by arrows. The mobile terminal device 10 has a plate-like housing H1. Therefore, although not depicted in FIG. 1, the distance (thickness) between the front surface and the rear surface of the housing H1 is short compared to the external dimensions of the front surface or the rear surface. It is assumed that the upper side of FIG. 1 is the upper side of the housing H1, and the lower side of the paper is the lower side of the housing H1. Note that the control unit 13 is housed inside the housing H1. Hereinafter, in this specification, the vertical direction of the housing H1 is also referred to as the Y direction, and the width direction of the housing H1 orthogonal to the Y direction is also referred to as the X direction.

As shown in FIG. 1, a display unit 19 is provided on the front surface of the housing H1, and a first camera H3 is provided at the upper center position of the display unit 19. As shown in FIG. The first camera H<b>3 photographs the user himself/herself while the user operating the mobile terminal device 10 is operating, and displays the image on the display unit 19 . The front surface of the housing H1 corresponds to the first surface of the outer surface of the housing H1.

A circular recess 15A that covers the sensor 15 is formed on the rear surface of the housing H1, and a second camera H4 is provided above the recess 15A. The concave portion 15A, that is, the position where the sensor 15 is provided is, for example, when the housing H1 is gripped with one hand and the finger of the gripped hand operates the sensor 15, the finger is positioned diagonally below the sensor 15 toward the sensor 15. This is the position to reach. The sensor 15 is arranged directly below a circular concave portion 15A formed near the center of the rear surface of the housing H1. The sensor 15 is covered with the outer wall of the housing H1 forming the recess 15A. The sensor 15 detects finger contact through the outer wall of the housing H1 forming the recess 15A. Therefore, in the present embodiment, the sensor 15 and the outer wall of the housing H1 forming the recess 15A can be called a sensor that detects an operation by a finger (an object having a fingerprint). Hereinafter, even when the sensor 15 detects contact with a finger through the outer wall of the housing H1 forming the recess 15A, it is simply referred to as "the sensor 15 detects contact with a finger". Note that the second camera H4 takes an image of the subject in the rearward direction of the housing H1 and displays it on the display unit 19. FIG. The rear surface of the housing H1 corresponds to the rear surface of the outer surface of the housing H1.

FIG. 2 is a hardware configuration diagram of the mobile terminal device according to the embodiment. The mobile terminal device 10 has a processor 11 , a main storage unit 12 , and input/output components connected through various interfaces, and executes information processing according to programs stored in the main storage unit 12 . The display unit 19 and the display control unit 191 can be exemplified as the first input/output component. Further, the touch panel 18 and the touch event control section 181 can be exemplified as the second input/output component. As the third input/output component, the sensor 15, the sensor input filter section 151, the sensor input analysis section 152, and the scroll tap event control section 153 can be exemplified. The communication unit 17 can be exemplified as the fourth input/output component.

The processor 11 executes a computer program executably developed in the main storage unit 12 and provides the functions of the mobile terminal device 10 . The processor 11 may be multi-core, or may include a dedicated processor that performs signal processing and the like. Processor 11 may include dedicated hardware circuits for performing signal processing, sum-of-products operations, vector operations, and other processing.

The main storage unit 12 stores computer programs executed by the processor 11, data processed by the processor 11, and the like. The main storage unit 12 is a Dynamic Random Access Memory (DRAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), a flash memory, or the like.

Note that the mobile terminal device 10 may have an external storage section in addition to the main storage section 12 . The external storage unit is used, for example, as a storage area that assists the main storage unit 12, and stores computer programs executed by the processor 11, data processed by the processor 11, and the like.

Also, the display unit 19 is, for example, a liquid crystal display, an electroluminescence panel, or the like. The display control unit 191 is, for example, an image memory that stores images displayed on the display unit 19 and a controller that executes graphics processing. However, the display control section 191 may be formed by the processor 11 and the program on the main storage section 12 . Also, the display control unit 191 may be formed by a processor dedicated to signal processing and a program stored in a memory or the like. Also, the display control unit 191 may include a dedicated hardware circuit.

The touch panel 18 is arranged on the screen of the display unit 19, detects contact with a finger, and obtains coordinate values of the contact position. The touch event control unit 181 notifies the processor 11 of the acquired coordinate values of the contact position and the time information on the touch panel 18 . The touch event control unit 181 may be formed by the processor 11 and a program on the main storage unit 12, or may be formed by a dedicated processor and a program stored in a memory (not shown). Also, the touch event control unit 181 may include a dedicated hardware circuit.

The communication unit 17 exchanges data with other devices on the network. The communication unit 17 is, for example, a terminal-side communication device that can be connected to a base station of a mobile phone network. However, the communication unit 17 may include an interface to a wireless Local Area Network (LAN), an interface for Bluetooth (registered trademark), and an interface for Bluetooth Low Energy (BLE).

FIG. 3 is a plan view illustrating a detection surface of a sensor included in the mobile terminal device according to the embodiment; The sensor 15 includes a contact sensor 15C that detects finger contact and a fingerprint sensor 15B that detects the fingerprint of the finger. The contact sensor 15C has an array of multiple detection elements 15CE. Therefore, the contact sensor 15C detects a plurality of contact points from the contact surface of a person's finger by means of the arranged plurality of detection elements 15CE. The number of contact points corresponds to the contact area of the finger. In the example of FIG. 3, the contact sensors 15C detect finger contact from a total of 12 points in a 4×3 array. Capacitive sensors are arranged at 12 locations, respectively, and detect finger contact via the outer wall of the recess 15A formed in the housing H1. The plurality of detection elements 15CE is an example of a plurality of detection units that detect finger contact.

Fingerprint sensor 15B, on the other hand, also includes an array of capacitive sensors. However, the fingerprint sensor 15B has a finer array of capacitance sensors than the contact sensor 15C, forms a pixel array, and acquires an image. The number of array elements (corresponding to the number of pixels) of the capacitance sensors of the fingerprint sensor 15B is about 1000 to 10000 times the number of the capacitance sensors of the contact sensor 15C. For example, the number of pixels is approximately 100×100 to 400×400.

Therefore, the contact sensor 15C roughly and rapidly detects the presence or absence of contact from the contact surface of the finger (contact with the outer wall of the housing H1 as described above). On the other hand, the fingerprint sensor 15B acquires a finer image of the contact surface than the contact sensor 15C. However, the time taken by the fingerprint sensor 15B to acquire an image of the entire contact surface is longer than the time taken by the contact sensor 15C to detect the presence or absence of finger contact. Therefore, in the present embodiment, control unit 13 detects a rough contact state of a finger by contact sensor 15C in a relatively short time, and takes a relatively long time to detect a fine fingerprint on the contact surface by fingerprint sensor 15B. Get an image of

Note that the control unit 13 receives a report of the number of contact points, which corresponds to the area with which the finger is in contact, from the contact sensor 15C. The control unit 13 determines that the finger has touched the sensor 15 when the number of contact points reported from the contact sensor 15C exceeds the first determination value. In this case, the first determination value may be a number smaller than the number of detection elements of the contact sensor 15C. Also, the first determination value may be the total number of detection elements. Further, the control unit 13 determines that the finger is separated from the sensor 15 when the number of contact points reported from the contact sensor 15C falls below the second determination value. The second determination value may not be 0. Further, the control unit 13 adopts a value smaller than the first determination value as the second determination value, thereby forming a hysteresis when detecting contact by the user's finger and detecting contact with the sensor 15 by the user's finger. Separation can be judged stably.

Returning to FIG. 2, the description of the sensor 15 is continued. As described with reference to FIG. 1, the sensor 15 is arranged inside the housing H1 so as to be covered by the recess 15A on the rear surface of the housing H1. The sensor 15 acquires an image of the user's fingerprint and detects contact with the user's finger via the recess 15A. The sensor input filter unit 151 shapes the signal detected by the sensor 15 using a signal processing filter. For example, the sensor input filter unit 151 removes noise from the signal detected by the sensor 15 and performs processing to emphasize the edges of the image. The sensor input analysis unit 152 forms an image of the user's fingerprint based on the signal from the sensor input filter unit 151 . Based on the signal from the sensor input filter unit 151, the sensor input analysis unit 152 also generates an ON/OFF binary signal that is the result of determining whether or not the contact sensor 15C is in contact. Based on the image from the sensor input analysis unit 152, the scroll tap event control unit 153 detects a slide operation or a tap operation by the user's finger on the sensor 15 (recess 15A). The slide operation is, for example, an operation of contacting the sensor 15 with a finger and sliding the finger on the sensor 15 while maintaining the contact state. Then, the scroll tap event control unit 153 reports to the processor 11 the direction of the slide operation, the distinction between the tap and the long tap, and the like.

At least one of the sensor input filter unit 151 , the sensor input analysis unit 152 , and the scroll tap event control unit 153 may be formed by the processor 11 and programs on the main storage unit 12 . Alternatively, at least one of these may be formed by a dedicated processor and a program stored in memory. Alternatively, at least one of these may also include dedicated hardware circuitry.

In this embodiment, the processor 11 and the main storage unit 12 are called a control unit 13. FIG. However, the control unit 13 may include at least part of the display control unit 191 , the touch event control unit 181 , the sensor input filter unit 151 , the sensor input analysis unit 152 and the scroll tap event control unit 153 .

FIG. 4 is a diagram schematically showing a region where a control unit detects a slide operation by a user's finger on the detection surface of the sensor according to the embodiment; In FIG. 4 , the position first touched by the user's finger is defined as a center point P1, and a dotted line L1 passing through the center point P1 exemplifying the vertical direction and a dotted line L2 passing through the center point P1 exemplifying the horizontal direction are illustrated. be done. The detection surface of the sensor 15 is divided into four detection areas R1, R2, R3 and R4. In this embodiment, the right direction on the detection surface of the sensor 15 is also referred to as the 0-degree direction, the upward direction as the 90-degree direction, the left direction as the 180-degree direction, and the downward direction as the 270-degree direction.

The detection region R1 is a region above the center point P1 starting from the center point P1, and is a region defined by an angle range of a predetermined angle _θ1 in the horizontal direction with the dotted line L1 extending in the vertical direction as the center line. be. The control unit 13 detects a slide operation from the center point P1 to the detection region R1 as a slide operation upward (90 degrees direction) from the center point P1. The detection region R2 is a region on the left side of the center point P1 starting from the center point P1, and is a region defined by an angle range of a predetermined angle _θ1 in the vertical direction with the dotted line L2 extending in the horizontal direction as the center line. be. The control unit 13 detects a slide operation from the center point P1 to the detection region R2 as a slide operation from the center point P1 to the left (180 degree direction).

The detection region R3 is a region below the center point P1 starting from the center point P1, and is defined by an angle range of a predetermined angle _θ1 in the horizontal direction with the dotted line L1 extending in the vertical direction as the center line. is. The control unit 13 detects a slide operation from the center point P1 to the detection region R3 as a slide operation from the center point P1 downward (270-degree direction). The detection region R4 is a region on the right side of the center point P1 starting from the center point P1, and is a region defined by an angle range of a predetermined angle _θ1 in the vertical direction with the dotted line L2 extending in the horizontal direction as the center line. be. The control unit 13 detects a slide operation from the center point P1 to the detection region R4 as a slide operation from the center point P1 to the right (0 degree direction). The predetermined angle _θ1 is an example of the "first angle range". Any one of the detection regions R1, R2, R3, and R4 is an example of the "first region."

That is, the control unit 13 detects the up, down, left, and right directions as a detection region R1 defined by a predetermined angle range _θ1 centered (starting point) on the center point P1 where the finger touches the detection surface of the sensor 15. , R2, R3, R4. The control unit 13 detects the moving direction of the finger by determining which of the detection areas R1, R2, R3, and R4 the finger touching the sensor 15 moves from the center point P1. In other words, the control unit 13 limits the directions in which the user's finger slide operation on the sensor 15 is detected to the four directions of up, down, left, and right, and sets the area for detecting the movement operation in each of the limited directions to the angle range θ ₁ . Extends to the area specified in

In addition, since the sensor 15 is provided on the back surface of the housing H1, when the control unit 13 detects that the detection surface of the sensor 15 is slid to the right (0 degree direction), the control unit 13 causes the display unit 19 to move. Scroll the screen to the left. When the control unit 13 detects a leftward (180-degree direction) slide operation on the detection surface of the sensor 15, the control unit 13 scrolls the screen of the display unit 19 rightward.

5 and 6 are diagrams for comparing the trajectory of a finger operating the sensor provided on the back surface of the mobile terminal device according to the embodiment and the input values received by the control unit. FIG. 5 is a diagram exemplifying a case where the user tries to move his finger upward, and FIG. 6 is a diagram exemplifying a case where the user tries to move his finger rightward. A user often holds the mobile terminal device 10 with one hand and operates the sensor 15 with the fingers of the holding hand. When operated in this manner, even if the user intends to move the finger straight upward from the center point P1, the value detected by the sensor 15 (actual finger movement trajectory) may deviate slightly from the straight upward direction. Also, even if the user intends to move the finger straight to the right from the center point P1, the detected value of the sensor 15 may deviate slightly from the direction straight to the right, as exemplified by the locus F2 in FIG. . This is because when the sensor 15 is operated with the finger of the hand holding the mobile terminal device 10, the finger touches the sensor 15 from an oblique direction due to the structure of the hand. , and the movement of the finger relative to the sensor 15 . In addition, friction between the surface of the sensor 15 and the finger causes a stick-slip phenomenon, and as a result of the finger repeatedly moving and stopping, the finger moves in a direction different from the user's intention. be done.

In the present embodiment, a detection region R1 wider than the straight upward direction (90-degree direction) is adopted as the region in which the control unit 13 detects the upward sliding operation of the finger of the user who slides the sensor 15. ing. The detection area R1 includes an angular range expanded by a predetermined angle from the straight upward direction. Further, in the present embodiment, the control unit 13 detects a rightward sliding operation of the finger of the user who slides the sensor 15, and a detection area R4 wider than the straight rightward direction (0 degree direction) is provided. Adopted. The detection area R4 includes an angular range expanded by a predetermined angle from the straight rightward direction.

The control unit 13 calculates the angle of the trajectory F1 detected by the sensor 15 with respect to the X direction. If the calculated angle is within the detection region R1, the control unit 13 determines that the finger has moved straight up. The control unit 13 also calculates the angle of the trajectory F2 detected by the sensor 15 with respect to the X direction. If the calculated angle is within the detection region R4, the control unit 13 determines that the finger has moved straight to the right.

Through such processing, even if the finger moves in a direction slightly deviated from the 90-degree direction as shown by the trajectory F1 in FIG. It can be accepted as the input value I1. Also, even if the finger moves in a direction slightly deviated from the 0-degree direction as shown by the trajectory F2 in FIG. be able to. The same applies to the detection regions R3 and R4.

7 is a diagram illustrating an example of a processing flow of the mobile terminal device according to the embodiment; FIG. A processing flow of the mobile terminal device 10 according to the embodiment will be described below with reference to FIG.

At T1, a slide operation to the sensor 15 by the user's finger is started. The sensor 15 reports to the control unit 13 the position touched by the finger that initiates the slide operation. The control unit 13 takes the reported position as the center point P1. At T2, based on the signal detected by the sensor 15, the control unit 13 detects the moving direction from the center point P1 of the finger moving while maintaining the state of touching the sensor 15. FIG. The control unit 13 calculates the angle of the detected moving direction (for example, the angle with respect to the X direction).

At T3, the control unit 13 determines to which detection region R1, R2, R3, or R4 the finger moved by the slide operation belongs, based on the angle calculated at T2. The control unit 13 determines the direction of the slide operation based on the determined area. At T4, the control unit 13 scrolls the screen displayed on the display unit 19 in the direction corresponding to the area determined at T3.

FIG. 8 is a diagram showing an example of a screen scrolled by the processing flow of FIG. FIG. 8 illustrates a case where the control unit 13 detects an upward finger slide operation (an upward scroll operation) by the processing flow of FIG. 7 . FIG. 8 illustrates transition from the left state to the right state by scrolling up. The control unit 13 can scroll the screen displayed on the display unit 19 in the direction desired by the user by detecting the user's finger operation on the sensor 15 according to the processing flow illustrated in FIG. 7 .

<Action and effect of the embodiment>
In the embodiment, the control unit 13 expands the detection areas R1, R2, R3, and R4 to detect the movement direction of the movement operation by the user's finger slide operation on the sensor 15, thereby detecting the user's intention. You can achieve scrolling in the direction along the . Note that the technology disclosed in the embodiments is not limited to scrolling, and may be applied to an operation of moving a cursor, an image, or the like displayed on the display unit 19 .

Various variations are conceivable for setting the detection area on the detection surface of the sensor 15 . Examples of variations thereof will be described below as modified examples.

<First modification>
In the embodiment, the entire detection surface of the sensor 15 is divided into four detection regions R1, R2, R3, and R4. Detected the movement direction by slide operation. In the first modification, the detection surface of the sensor 15 is divided into four regions for detecting the moving direction of the finger, and dead regions for not detecting the slide operation are provided between these divided regions. The same reference numerals are assigned to the same configurations as in the embodiment, and the description thereof is omitted. A first modified example will be described below with reference to the drawings.

FIG. 9 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the first modification. In the first modification, the detection surface of the sensor 15 is divided into detection areas R1a, R2a, R3a, and R4a, which are areas for detecting slide operations, and dead areas R5, which are areas for which no slide operations are detected. In this case, the detection area R1a, the detection area R2a, and the dead area R5 are examples of the "first area," the "second area," and the "third area," respectively.

The detection area R1a is an area above the center point P1 starting from the center point P1, and extends at a predetermined angle θ2 _smaller than the predetermined angle _θ1 in the left-right direction with the dotted line L1 extending in the vertical direction as the center line. A region defined by a range. The control unit 13 detects a slide operation from the center point P1 to the detection region R1a as a slide operation from the center point P1 in the direction of 90 degrees. The detection region R2a is a region on the left side of the center point P1 starting from the center point P1, and is a region defined by an angle range of a predetermined angle _θ2 in the vertical direction with the dotted line L2 extending in the horizontal direction as the center line. be. The control unit 13 detects a slide operation from the center point P1 to the detection region R2a as a slide operation from the center point P1 in the direction of 270 degrees.

The detection region R3a is a region below the center point P1 starting from the center point P1, and is defined by an angular range of a predetermined angle _θ2 in the horizontal direction with the dotted line L1 extending in the vertical direction as the center line. is. The control unit 13 detects a slide operation from the center point P1 to the detection region R3a as a slide operation from the center point P1 in the direction of 270 degrees. The detection region R4a is a region on the right side of the center point P1 starting from the center point P1, and is a region defined by an angle range of a predetermined angle _θ2 in the vertical direction with the dotted line L2 extending in the horizontal direction as the center line. be. The control unit 13 detects a slide operation from the center point P1 to the detection region R4a as a slide operation from the center point P1 in the direction of 0 degrees.

As described above, the detection regions R1a, R2a, R3a, and R4a are defined by the predetermined angle _θ2 that is smaller than the predetermined angle _θ1 that defines the regions R1, R2, R3, and R4 according to the embodiment. Therefore, there is an area in which the slide operation is not detected among the detection areas R1a, R2a, R3a, and R4a, and this area becomes the dead area R5. The control unit 13 discards the slide operation on the dead area R5 without detecting it.

When the detection surface of the sensor 15 is viewed clockwise from the detection area R1a, the detection area R1a→the dead area R5→the detection area R2a→the dead area R5→the detection area R3a→the dead area R5→the detection area R4a→the dead area R5→the detection area. R1a. That is, in the first modified example, the detection area for detecting the slide operation and the dead area for not detecting the slide operation are alternately arranged on the detection surface of the sensor 15 . In other words, in the first modified example, each of the detection areas is sandwiched between dead areas.

FIG. 10 is a diagram illustrating an example of a processing flow of the mobile terminal device according to the first modification; The processing flow according to the first modification differs from the processing flow (FIG. 7) according to the embodiment in that it includes the processing of J1.

At J1, the control unit 13 determines whether or not the moving direction of the finger belongs to the dead area R5 based on the angle calculated at T2. If it belongs to the dead area R5 (YES in J1), the process returns to T1. If it does not belong to the dead region R5 (NO in J1), the process proceeds to T3.

According to the first modification, for example, even if the user's finger moved on the sensor 15 with the intention of moving upward moves out of the detection area R1a, the finger suddenly moves in another direction (for example, rightward). Detection as movement is suppressed. Further, when the finger reaches the dead area R5, the control section 13 does not detect the slide operation, so that the display section 19 stops scrolling. Therefore, the control unit 13 can make the user recognize that the finger is out of the detection area.

<Second modification>
In the first modification, the detection areas R1a, R2a, R3a, and R4a are defined as areas having the same angular range of the predetermined angle _θ2 . In the second modified example, a configuration will be described in which the detection area for detecting the horizontal direction is set wider than the detection area for detecting the vertical direction. The same reference numerals are assigned to the same configurations as those of the embodiment and the first modified example, and the description thereof is omitted. A second modification will be described below with reference to the drawings.

FIG. 11 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the second modification. In the second modification, the detection surface of the sensor 15 is divided into detection areas R1b, R2b, R3b, and R4b, which are areas for detecting slide operations, and dead areas R5 arranged between the detection areas.

The detection areas R1b and R3b for detecting the vertical direction are defined by an angle range of a predetermined angle _θ3 smaller than the predetermined angle _θ2 in the horizontal direction with the dotted line L1 extending in the vertical direction as the center line. The detection regions R2b and R4b for detecting the horizontal direction are defined by an angle range of a predetermined angle _θ4 larger than the predetermined angle _θ2 in the vertical direction with the dotted line L2 extending in the horizontal direction as the center line. In this case, the predetermined angle _θ2 is an example of the "first angle range", and the predetermined angle _θ4 is an example of the "second angle range".

In the second modification, the detection areas R2b and R4b for detecting finger movement in the horizontal direction have an angle range of a predetermined angle _θ4 larger than the predetermined angle _θ1 . Further, the detection regions R1b and R3b for detecting the movement of the finger in the vertical direction have an angle range of a predetermined angle _θ3 smaller than the predetermined angle _θ1 . This is because, when holding the mobile terminal device 10 with one hand and performing a sliding operation on the sensor 15 with the finger of the holding hand, it is considered difficult to move the finger in the horizontal direction compared to the vertical direction. By adopting such a configuration, it is possible to facilitate the slide operation in the direction in which it is difficult to move the finger.

<Third modification>
In the second modification, the angular range of the detection regions R2b and R4b for detecting the horizontal direction is set wider than the detection regions R1b and R3b for detecting the upward direction or the downward direction. In the third modified example, a configuration will be described in which the angular range of the detection area is changed according to the movable range of the finger. The same reference numerals are given to the same configurations as those of the embodiment, the first modified example, and the second modified example, and the description thereof will be omitted. A third modification will be described below with reference to the drawings.

FIG. 12 is a diagram schematically showing a region where the control unit detects an operation by a user's finger on the detection surface of the sensor according to the third modification. In the third modification, the detection surface of the sensor 15 is divided into detection areas R1b, R2c, R3b, and R4c, which are areas for detecting slide operations, and dead areas R5 arranged between the detection areas.

In the third modification, the detection regions R2c and R4c for detecting finger movement in the horizontal direction have an angle range of a predetermined angle _θ5 larger than the predetermined angle _θ1 . In addition, in the third modified example, the detection area The regions of R2c and R4c are extended downward. By setting the detection area according to the movable range of the finger in this way, it is possible to perform an operation more in line with the user's intention.

<Fourth modification>
In the embodiment and the first to third modifications, the positions of the detection area and the dead area are not changed regardless of whether the mobile terminal device 10 is held and the sensor 15 is operated with the right hand or the left hand. In the fourth modified example, a configuration will be described in which the positions of the detection area and the dead area are changed depending on whether the hand holding the mobile terminal device 10 is the right hand or the left hand. The same reference numerals are assigned to the same configurations as those of the embodiment and the first to third modifications, and the description thereof will be omitted. A fourth modification will be described below with reference to the drawings.

FIG. 13 illustrates a case where the portable terminal device 10 is held with the right hand and the sensor 15 is slid with the index finger of the right hand. In such a case, the index finger of the right hand comes into contact with the sensor 15 diagonally from the lower left when viewed from the back of the mobile terminal device 10 (that is, from the diagonally lower right when viewed from the front of the mobile terminal device 10). Therefore, a sliding operation up, down, left, or right with the index finger of the right hand is likely to be in a direction rotated by a predetermined angle with respect to the up, down, left, or right direction of the sensor 15 .

In the fourth modification, considering the inclination of the finger with respect to the sensor 15 described in FIG. 13, the detection area described in the third modification is rotated by a predetermined angle _θ6 . In FIG. 13, the positions of the dotted lines L1 and L2 after rotation are illustrated as thick lines L1a and L2a. A suitable angle for the predetermined angle _θ6 may be determined by testing or the like. The inclination of the thick line L2a after the rotation (horizontal direction, that is, the line connecting the 0-degree direction and the 90-degree direction) matches, for example, the inclination of the right index finger that performs the slide operation toward the sensor 15 from obliquely below. By rotating the detection area, in the fourth modified example, it is possible to take into consideration the inclination of the finger with respect to the sensor 15 and to enable an operation in line with the user's intention. In addition, in the fourth modified example, the case of holding the mobile terminal device 10 with the right hand has been described, but the same applies to the case of holding the mobile terminal device 10 with the left hand.

Whether the hand holding the mobile terminal device 10 is the right hand or the left hand is registered in advance as information indicating whether the hand held by the user of the mobile terminal device 10 is the right hand or the left hand. The control unit 13 may make the determination based on the information obtained. Further, fingerprints of right and left fingers used for touch operation on sensor 15 are registered, and based on the fingerprints detected by fingerprint sensor 15B, it is determined whether the hand holding mobile terminal device 10 is the right hand. The control unit 13 may determine whether it is the left hand or the left hand.

<Fifth Modification>
In the embodiment and the first to fourth modifications, once the detection area is set, it does not change. In the fifth modified example, a configuration will be described in which the size of the detection area is changed according to the slide operation. The same reference numerals are assigned to the same configurations as those of the embodiment and the first to fourth modifications, and the description thereof will be omitted. A fifth modification will be described below with reference to the drawings.

First, it is assumed that the state before the sensor 15 detects the slide operation is the same as the first modified example illustrated in FIG. In other words, it is assumed that the detection areas for detecting slide operations up, down, left, and right have the same size. Here, when the control unit 13 detects a slide operation that continues for a predetermined distance or more in the left-right direction with respect to the sensor 15, the control unit 13 expands the detection area for detecting the slide operation in the left-right direction. state. That is, the control unit 13 resets the detection area so that the detection area for detecting the sliding operation in the horizontal direction is larger than the detection area for detecting the sliding operation in the vertical direction. Here, the predetermined distance may be appropriately determined so that the control unit 13 can detect the user's slide operation in accordance with the user's intention. In addition, although the sliding operation in the horizontal direction has been described in the fifth modification, the same applies to the sliding operation in the vertical direction. That is, when the control unit 13 detects a slide operation that continues for a predetermined distance or more in the horizontal direction with respect to the sensor 15, the detection area for detecting the slide operation in the vertical direction may be expanded.

An example of the processing flow of the processing described above will be described. FIG. 15 is a diagram illustrating an example of a processing flow of a mobile terminal device according to a fifth modification; The process illustrated in FIG. 15 is executed after T4 in the process flow (FIG. 10) according to the first modification. The same reference numerals are assigned to the same processes as those of the first modified example, and the description thereof will be omitted. An example of the processing flow of the mobile terminal device according to the fifth modification will be described below with reference to FIG. 15 .

At W1, when the control unit 13 detects continuation of the slide operation for a predetermined distance or longer without changing the direction of the slide operation (detection area touched by the finger moving by the slide operation), the control unit 13 shifts the area determined at T3. Expanding. After the process of W1, when the control unit 13 further detects a slide operation, the process proceeds to T1a and T2a. The processing of T1a and T2a is the same as the processing of T1 and T2 in FIG. 10, respectively, so the description thereof will be omitted. At W2, the control unit 13 continuously samples the position of the finger performing the slide operation at predetermined intervals. The control unit 13 determines the direction of the slide operation by applying the same direction filter to the history of the sampled finger positions. The same-direction filter is, for example, a filter used to determine whether or not the history of finger positions indicates slide operations in the same direction by removing noise from the history of finger positions. The processing of T3a and T4a is the same as the processing of T3 and T4 in FIG. 10, respectively, so the description thereof will be omitted.

According to the fifth modification, the control unit 13 expands the detection area in the direction in which the slide operation is detected, so the slide operation in the same direction becomes easier.

<Sixth modification>
In the embodiment and the first to fifth modifications, the control unit 13 detects slide operations in four directions of up, down, left, and right. In the sixth modification, a configuration will be described in which the control unit 13 detects a slide operation in an oblique direction in addition to the four directions of up, down, left, and right. The same reference numerals are assigned to the same configurations as those of the embodiment and the first to fifth modifications, and the description thereof will be omitted. A sixth modification will be described below with reference to the drawings. The oblique direction is an example of the "third direction".

FIG. 16 is a diagram schematically showing a region where the control unit detects an operation with a user's finger on the detection surface of the sensor according to the sixth modification. The detection surface of the sensor 15 in the sixth modification has the detection area R6 (R6-1 to R6-4) instead of the dead area R5. different from

A detection region R6-1 for detecting an upward-right slide operation is arranged to the right of the detection region R1a for detecting an upward sliding operation, and an upward-left detection region is arranged to the left of the detection region R1a. A detection area R6-2 for detecting a sliding operation of is arranged. A detection region R6-3 for detecting a slide operation diagonally downward to the left is arranged to the left of the detection region R3a for detecting a downward slide operation, and a detection region R6-3 for detecting a slide operation diagonally downward to the left is arranged to the right of the detection region R3a diagonally downward to the right. A detection region R6-4 for detecting a sliding operation of is arranged. In the sixth modification, the screen displayed on the display unit 19 can be scrolled diagonally by arranging the detection area R6 for detecting the slide operation in the diagonal direction. Region R6 is an example of a "fourth region".

According to the sixth modification, the control unit 13 can scroll the screen displayed on the display unit 19 in an oblique direction by detecting a slide operation in an oblique direction.

<Other variations>
The control unit 13 continuously receives signals from the slide operation on the sensor 15 . The control unit 13 may determine the direction of movement of the slide operation by performing angle determination at predetermined intervals to determine which detection region the direction of the slide operation belongs to, with respect to the signals that are continuously received.

Also, the finger that performs the slide operation on the sensor 15 may repeat moving and stopping due to the stick-slip phenomenon. For example, it is conceivable that the control unit 13 detects the stop of the slide operation after detecting the slide operation in a certain direction, and then detects the slide operation in a direction slightly deviated from the first detected direction. . FIG. 17 is a diagram illustrating the trajectory of a finger that repeatedly moves and stops on the detection surface of the sensor due to the stick-slip phenomenon. In FIG. 17, each of arrows A1, A2, A3, and A4 exemplifies the trajectory along which the finger moves, and the end points of arrows A1, A2, A3, and A4 exemplify the position where the finger stops due to the stick-slip phenomenon. Also, the starting point of the arrow A1 exemplifies the point where the finger starts touching the sensor 15 . The starting points of arrows A2, A3, and A4 illustrate the points where the fingers stopped due to the stick-slip phenomenon start moving again.

The control unit 13 determines the angle of the slide operation with the starting points of the arrows A1, A2, A3, and A4 as the center point P1. For example, for the slide operation exemplified by the arrow A1, the control unit 13 sets the detection area with the starting point of the arrow A1 as the center point P1, and determines the direction of the slide operation. Subsequently, the control unit 13 sets the detection area with the starting point of the arrow A2 as the center point P1, and determines the direction of the slide operation. The control unit 13 can determine the slide operation by performing such processing also for the arrows A3 and A4. Note that the control unit 13 may individually determine the slide operation for each of the arrows A1, A2, A3, and A4. The direction of the slide operation may be determined by averaging (angle).

The embodiments and modifications disclosed above can be combined.

<<Computer-readable recording medium>>
An information processing program that causes a computer or other machine or device (hereinafter referred to as a computer or the like) to implement any of the functions described above can be recorded in a computer-readable recording medium. By causing a computer or the like to read and execute the program of this recording medium, the function can be provided.

Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer, etc. Say. Examples of such recording media that can be removed from a computer or the like include flexible discs, magneto-optical discs, Compact Disc Read Only Memory (CD-ROM), Compact Disc-Recordable (CD-R), and Compact Disc-ReWritable. (CD-RW), Digital Versatile Disc (DVD), Blu-ray Disc (BD), Digital Audio Tape (DAT), 8 mm tape, and memory cards such as flash memory. In addition, there are a hard disk, a ROM, and the like as recording media fixed to a computer or the like.

10 mobile terminal device 11 processor 12 main storage unit 13 control unit 15 sensor 151 sensor input filter unit 152 sensor input analysis unit 153 scroll tap event control unit 15A recess 15B fingerprint sensor 15C contact sensor 17 communication unit 18 touch panel 181 touch event control unit 19 Display unit 191 Display control unit

Claims (8)

a housing having a display;
a sensor provided on the back surface of the surface of the housing on which the display unit is provided and detecting an operation by a finger and a fingerprint of the finger ;
a storage unit that stores the fingerprint of the first finger of the user's right hand and the fingerprint of the second finger of the user's left hand;
a control unit that scrolls the display of the display unit in the direction in which the slide operation is performed from the position where the sensor is touched,
The control unit
detecting a slide operation to a first area defined by a first angle range with the touched position as a starting point in the sensor as a slide operation in a first direction;
Rotating the first region by a predetermined angle with the touched position as a starting point, depending on whether the finger touching the sensor is the first finger or the second finger;
mobile terminal equipment. The control unit
discarding a slide operation to a third area interposed between the first area and a second area for detecting a slide operation in a second direction different from the first direction;
The mobile terminal device according to claim 1. The control unit
A slide operation to a fourth area interposed between the first area and a second area for detecting a slide operation in a second direction different from the first direction is performed in the first direction and the second direction. Detecting as a slide operation in the third direction, which is an intermediate direction,
The mobile terminal device according to claim 1. the first direction is upward or downward;
A fifth area in which the control unit detects a slide operation in a fourth direction orthogonal to the first direction is defined by a second angle range wider than the first angle range with the touched position as a starting point,
The mobile terminal device according to any one of claims 1 to 3. The sensor is provided at a position where a finger of one hand gripping the housing reaches the sensor from an obliquely downward direction,
The angular range of the first region is determined based on the movable range of the finger reaching the sensor from the diagonally downward direction.
The mobile terminal device according to any one of claims 1 to 4. When the control unit detects the slide operation to the first area, the control unit expands the first area to an angle range wider than the first angle range.
The mobile terminal device according to any one of claims 1 to 5. a housing having a display;
A direction in which a computer, which is provided on the back surface of the housing on which the display unit is provided and is provided with a sensor for detecting an operation by a finger and a fingerprint of the finger , performs a slide operation from a position where the sensor is touched. and an information processing method for scrolling the display on the display unit, wherein the computer
The detected fingerprint detected by the sensor is collated with a storage unit that stores the fingerprint of the first finger of the user's right hand and the fingerprint of the second finger of the user's left hand, and the finger that touches the sensor is the first finger or the second finger,
detecting a slide operation to a first area defined by a first angular range with the touched position as a starting point in the sensor as a slide operation in a first direction;
Rotating the first region by a predetermined angle with the touched position as a starting point, depending on whether the finger that touched the sensor is the first finger or the second finger;
Information processing methods. a housing having a display;
A direction in which a slide operation is performed from a position where the sensor is touched to a computer provided with a sensor that detects an operation by a finger and a fingerprint of the finger and is provided on the back surface of the surface of the housing on which the display unit is provided. and an information processing program for scrolling the display of the display unit, wherein the computer,
The detected fingerprint detected by the sensor is collated with a storage unit that stores the fingerprint of the first finger of the user's right hand and the fingerprint of the second finger of the user's left hand, and the finger that touches the sensor is the first finger or the second finger,
causing the sensor to detect, as a slide operation in a first direction, a slide operation to a first region defined by a first angle range with the touched position as a starting point ;
Rotating the first region by a predetermined angle with the touched position as a starting point, depending on whether the finger that touched the sensor is the first finger or the second finger;
Information processing program.

Images