WO2011077525A1

WO2011077525A1 - Electronic device, operation detection method and operation detection program

Info

Publication number: WO2011077525A1
Application number: PCT/JP2009/071399
Authority: WO
Inventors: 亜佐子西田; 智菊地
Original assignee: 富士通株式会社
Priority date: 2009-12-24
Filing date: 2009-12-24
Publication date: 2011-06-30
Also published as: JPWO2011077525A1

Abstract

An electronic device is provided with a touch input unit (4), a pattern recognition unit (6), a registration unit (pattern registration unit (8)), and a pattern determination unit (10). The pattern recognition unit recognizes a pattern using at least two kinds of physical information obtained from a touch input as elements of determination. The pattern registration unit registers the recognized pattern. When the recognized pattern matches a registration pattern in the registration unit or matches the approximate range of the registration pattern, the pattern determination unit generates an output indicating the matching.

Description

Electronic device, operation detection method, and operation detection program

The present invention relates to operation detection of an electronic device equipped with a touch panel, such as a mobile terminal device, and relates to an electronic device, an operation detection method, and an operation detection program that specify an operation pattern with a plurality of physical elements obtained from touch input, for example.

In a mobile terminal device equipped with a touch panel, various inputs such as input of characters and figures, selection input, etc. can be performed by touching the touch panel with a finger or a touch pen.

In this type of portable terminal device, there is known a control for switching the key input mode of the touch panel to an erroneous operation prevention mode and invalidating the call-ending operation by key input (Patent Document 1).

JP 2005-269567 A

In a mobile terminal device equipped with a touch panel, during a call, it is possible to recognize that the ear touches the touch panel and lock the call, thereby prohibiting the cancellation of the call. This locked state can be released by pressing an unlock button on the mobile terminal device, and the operation of the end button is invalidated during a call. That is, disabling the end button operation is for preventing an inadvertent end. For this reason, in order to execute the end call, it is necessary to operate the end call button after unlocking, which is inconvenient.

Also, if a lock release button used for unlocking is installed, its operation and control are required. Therefore, when a simple touch operation instead of the unlock button is assigned to the touch panel together with the lock function, there is an inconvenience that the lock is released by an inadvertent touch.

Accordingly, an object of the electronic device, the operation detection method, and the operation detection program of the present disclosure is to improve touch input discrimination by using at least two types of physical information as determination elements and to improve the convenience of touch operation. .

In order to achieve the above object, the electronic device of the present disclosure includes a touch input unit, a pattern recognition unit, and a pattern determination unit. The touch input unit is means for inputting by touch or stroke with a finger, a touch pen, or the like. The pattern recognition unit recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. The pattern determination unit matches the registered pattern when the pattern recognized by the pattern recognition unit matches the registered pattern registered in advance in the registration unit or the approximate range of the registered pattern. Alternatively, an output indicating that the approximate range of the registered pattern is met is generated.

In order to achieve the above object, the operation detection method of the present disclosure is an operation detection method executed by an electronic device equipped with a touch input unit, and includes a pattern recognition step and a pattern determination step. The pattern recognition step recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. In the pattern determination step, if the recognized pattern matches a registered pattern registered in advance in the registration unit or matches an approximate range of the registered pattern, the pattern determining step matches the registered pattern or the registered pattern Produces an output indicating that the approximate range is met.

In order to achieve the above object, an operation detection program of the present disclosure is an operation detection program executed by an electronic device equipped with a touch input unit, and includes a pattern recognition function and a pattern determination function. The pattern recognition function recognizes a pattern using at least two types of physical information obtained from touch input as determination elements. The pattern determination function matches the registered pattern when the recognized pattern matches the registered pattern registered in advance in the registration unit or the approximate range of the registered pattern, or the registered pattern Produces an output indicating that the approximate range is met.

According to the electronic device, the operation detection method, or the operation detection program of the present disclosure, the following effects can be obtained.

(1) Since the touch input pattern is specified using at least two types of physical information obtained from the touch input as a determination element, the touch input can be identified more easily and the convenience of the touch operation can be improved.

(2) Since the pattern is recognized and generated using at least two types of physical information obtained from touch input as judgment elements, it is possible to eliminate or reduce the influence of touch input caused by unconscious operation by a person.

(3) Since a pattern generated by using at least two types of physical information as a determination factor is used, processing accuracy and security such as unlocking, end-of-call processing, application activation, and login to a website are improved.

Other objects, features, and advantages of the present invention will become clearer with reference to the accompanying drawings and each embodiment.

It is a figure which shows an example of the electronic device which concerns on 1st Embodiment. It is a flowchart which shows the process procedure of pattern registration and pattern determination of touch input. It is a figure which shows an example of the function part of the portable terminal device which concerns on 2nd Embodiment. It is a figure which shows an example of the hardware constitutions of the portable terminal device which concerns on 2nd Embodiment. It is a figure which shows the portable terminal device seen from the touchscreen part side. It is a figure which shows a portable terminal device provided with a pressure sensor part. It is a figure which shows the structural example of a touchscreen part. It is a figure which shows the touch input with respect to a touchscreen part. It is a figure which shows the touch detection of a touchscreen part. It is a flowchart which shows the process sequence of the position detection of touch input. It is a flowchart which shows the process sequence of acceleration calculation of touch input. It is a flowchart which shows the process sequence of the pressure calculation of touch input. It is a flowchart which shows the process sequence of angular velocity calculation. It is a flowchart which shows the process sequence of lock setting. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of an end call setting. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of an end talk. It is a flowchart which shows the process sequence of an end talk. It is a flowchart which shows the process sequence of the lock setting which concerns on 3rd Embodiment. It is a figure which shows input operation of touch input. It is a figure which shows a touch input. It is a figure which shows other input operation of a touch input. It is a figure which shows another touch input. It is a figure which shows the acceleration change of a touch input. It is a figure which shows the angle range of a touch input. It is a figure which shows the pressure change of a touch input. It is a figure which shows other input operation of a touch input. It is a figure which shows another touch input. It is a flowchart which shows the process sequence of lock release. It is a flowchart which shows the process sequence of the end story which concerns on 4th Embodiment. It is a figure which shows the example of a display of the inquiry display at the time of an end talk, and a selection button. It is a figure which shows the example of a display of an end talk. It is a flowchart which shows the process sequence of the starting setting of the application which concerns on 5th Embodiment. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of starting of an application. It is a flowchart which shows the specific process sequence of starting of an application. It is a flowchart which shows the process sequence of the login setting of the website which concerns on 6th Embodiment. It is a flowchart which shows the process sequence of pattern registration. It is a flowchart which shows the process sequence of login of a website. It is a flowchart which shows the specific process sequence of login of a website. It is a flowchart which shows the process sequence of the lock setting which concerns on 7th Embodiment. It is a figure which shows the comparative example of a portable terminal device. It is a flowchart which shows the process sequence of the end story which is a comparative example. It is a figure which shows an example of the personal computer which concerns on other embodiment. It is a figure which shows an example of the mobile telephone which concerns on other embodiment. It is a figure which shows an example of the remote controller which concerns on other embodiment.

[First Embodiment]

The first embodiment recognizes a touch input pattern using at least two types of physical information obtained from touch input as a determination element, and determines whether or not the input pattern matches a registered pattern or a neighborhood range of the registered pattern. Judgment. Here, the touch input includes a touch on the touch input unit or an input by a stroke thereof. The physical information that is a determination element is any one of the number of touch points, position, velocity, acceleration, angle, pressure, and angular velocity. The pattern includes, for example, a point, a line, or a figure specified by a touch input or a stroke thereof as described above, and the line may be continuous or discontinuous, or may be a curve. Good. By using the above-described physical information obtained from such touch input as a determination element, it is possible to eliminate touch input due to an unintentional operation (stroke) of the user and to reduce or prevent malfunctions due to unconscious operation.

For this first embodiment, refer to FIG. FIG. 1 is a diagram illustrating an electronic apparatus according to the first embodiment. The configuration of FIG. 1 is an example, and the present invention is not limited to such a configuration.

The electronic device 2 is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. As illustrated in FIG. 1, the electronic device 2 includes a touch input unit 4, a pattern recognition unit 6, and a pattern registration unit as functional units. 8 and a pattern determination unit 10.

The touch input unit 4 accepts a touch with a finger or a touch pen (for example, a stylus pen) as a touch input unit, and converts the input of the point and the stroke into electronic information. The touch point is a touch position by a finger or a touch pen, and is a recognizable point set in the touch input unit 4 or its line (may be a set of points). The stroke is, for example, a touch operation with a predetermined pressure or more, and is a movement (trajectory) of successive touch points.

The pattern recognition unit 6 is a functional unit that recognizes the touch input pattern using the above-described physical information obtained from the touch input to the touch input unit 4 as a determination element. Here, the physical information of the determination element is as described above. In this physical information, the number of points described above is, for example, the number of touch points that are equal to or higher than a predetermined pressure constituting a stroke. The position is, for example, the position of the touch point on coordinates, or the locus position of the touch point. The angle is, for example, the angle of the locus on the coordinates. The speed is, for example, the moving speed of the touch point on the coordinates. The acceleration is, for example, the acceleration in moving the touch point on the coordinates. The angular velocity is, for example, the angular velocity in the locus of the touch point on the coordinates. The pressure is, for example, a pressing force equal to or greater than a predetermined value (threshold value).

The pattern registration unit 8 is a functional unit that registers a pattern recognized by the pattern recognition unit 6. Since the registered pattern uses at least two types or two or more types of the physical information described above as determination factors, for example, there are various combinations such as the number of points and position, the point position and angle, and the point position and speed. The registered pattern is a pattern specified from the touch input, and may be the touch input itself, or a pattern within the approximate range of the specified pattern by giving a width to the pattern specified from the touch input. Also good.

The pattern determination unit 10 is a functional unit that determines whether or not the input pattern matches the registered pattern. That is, the pattern determination unit 10 determines whether or not the pattern recognized by the pattern recognition unit 6 matches the registered pattern in the pattern registration unit 8. In this case, as a determination target, it may be determined whether the input pattern matches the registered pattern and the approximate range. Therefore, it is determined whether the input pattern matches the registered pattern, or whether it matches the approximate range, and if it matches, an output representing it is generated.

According to such a configuration, the pattern recognition unit 6 recognizes the pattern by the above-described determination element by the touch input of the touch input unit 4, and the pattern recognition unit 6 stores the pattern recognized by the pattern recognition unit 6. be registered.

Therefore, an input pattern is recognized from the touch input of the touch input unit 4, it is determined whether the input pattern matches the registered pattern in the pattern registration unit 8 or its approximate range, and a determination output indicating the determination result is obtained. It is done.

Therefore, refer to FIG. 2 for registration and determination of this pattern. FIG. 2 is a flowchart showing a pattern processing procedure.

This pattern processing procedure is an example of the operation detection method or the operation detection program of the present disclosure. As shown in FIG. 2, touch input (step S1), pattern recognition (step S2), pattern registration presence / absence determination ( Step S3), pattern registration (Step S4), pattern determination (Step S5), and generation of determination output (Step S6) are included.

Therefore, in this processing procedure, the touch input unit 4 detects a touch input (step S1), and the pattern recognition unit 6 recognizes the pattern using the above-described physical information obtained from the touch input as a determination element (step S2).

After this pattern recognition, it is determined whether there is a pattern registration in the pattern registration unit 8 (step S3). If there is no pattern registration (NO in step S3), the recognized pattern is registered in the pattern registration unit 8 (step S4), and this process ends. In this case, the pattern to be registered may be a pattern obtained from touch input, and a pattern in an approximate range that approximates the pattern may be registered.

If there is pattern registration (YES in step S3), it is determined whether the input pattern recognized from the touch input matches the registered pattern (step S5). In this case, it may be determined whether or not the input pattern matches including the approximate range of the registered pattern. The pattern determination unit 10 generates and outputs a determination output indicating a determination result of whether the input pattern matches the registered pattern or its approximate range or not (step S6).

According to the above configuration, a touch input pattern is generated using at least two types of physical information obtained from touch input as a determination element, and the registered pattern and the input pattern are compared. As a result, the identifiability of touch input is improved and the convenience of touch operation can be improved.

The pattern is recognized and generated using the above-described physical information obtained from touch input as a determination element. Thereby, the influence of the touch input by a user's unconscious operation can be reduced.

Also, a pattern in which the above-described physical information is generated as a determination element is used. Therefore, it can be used for unlocking, end-of-call processing, application activation, login to the WWW (World Wide Web) site, etc., and the processing accuracy and security can be improved.

[Second Embodiment]

The second embodiment is a mobile terminal device equipped with a touch panel unit. This portable terminal device recognizes a touch input pattern using the above-described physical information obtained from touch input as a determination element, and determines whether or not the input pattern matches a registered pattern or a neighborhood range of the registered pattern It is the structure which has.

Referring to FIG. 3 for the second embodiment. FIG. 3 is a diagram illustrating an example of a functional unit of the mobile terminal device. The configuration shown in FIG. 3 is an example, and the present invention is not limited to such a configuration. In FIG. 3, the same parts as those in FIG.

The mobile terminal device 20 is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. As shown in FIG. 3, the mobile terminal device 20 includes a pattern determination unit 10, a pattern recognition unit 16, a touch detection unit 22, a position detection unit 24, an acceleration calculation unit 26, and a pressure calculation unit 28. , An angular velocity calculation unit 30, a pattern registration control unit 32, a communication control unit 34, a voice input / output control unit 36, a display control unit 38, and a lock control unit 40, which are processed by a computer (calculation, It is a functional unit realized by determination and various controls.

The pattern determination unit 10 is as described above. The pattern recognition unit 16 recognizes a touch input pattern using the above-described physical information obtained from the touch input detected by the touch detection unit 22 as a determination element. In this embodiment, physical information determination elements are as follows.

(1) The number of points touched on the touch panel unit 56 (FIG. 4) (the number of points is 1 in the examples of FIGS. 8, 9, 25 and 26, and the number of points in the examples of FIGS. 23, 24 and 28 is 2)
(2) Point position (coordinate position X, Y)
(3) Speed, acceleration, and angle to move the point (4) Pressure to press the touch panel 56 (Fig. 4) with your finger or touch pen

The touch detection unit 22 detects, for example, a touch or stroke with a finger or a touch pen as touch input to the touch panel unit 56 (FIG. 4), and obtains touch information as physical information.

The position detection unit 24 detects the touch position, stroke position, angle, etc. of a finger or a touch pen with respect to the touch panel unit 56 (FIG. 4), and obtains physical information (position information).

The acceleration calculation unit 26 calculates acceleration as physical information from position information of a touch input of a finger or a touch pen with respect to the touch panel unit 56 (FIG. 4).

The pressure calculation unit 28 calculates the pressure at the touch position of the finger or the touch pen with respect to the touch panel unit 56 (FIG. 4). That is, the pressure at the touch position received by the touch panel unit 56 is calculated, and the pressure is obtained as physical information.

The angular velocity calculation unit 30 calculates an angular velocity of the mobile terminal device 20 and outputs angular velocity information that is physical information.

The pattern registration control unit 32 controls registration of patterns recognized by the pattern recognition unit 16 described above. In this case, the pattern to be registered may be a pattern within the approximate range of the pattern recognized from the touch input. The pattern recognition unit 16 described above generates a touch input pattern using at least two types of physical information obtained from the touch detection unit 22, the position detection unit 24, the acceleration calculation unit 26, the pressure calculation unit 28, or the angular velocity calculation unit 30. recognize. The recognized pattern is registered or used for comparison with the registered pattern.

The communication control unit 34 controls wireless communication and voice communication. If the input pattern matches the registered pattern, the communication control unit 34 performs call control and call termination control according to the determination output.

The voice input / output control unit 36 controls output of voice signals and voice input.

The display control unit 38 controls the display of characters and images on the display unit 48 (FIG. 4).

The lock control unit 40 constitutes a functional unit that controls the unlocking of the functions of the mobile terminal device 20 and the lock input if the touch input is appropriate.

Next, referring to FIG. 4, FIG. 5, and FIG. 4 is a diagram illustrating a hardware configuration example of the mobile terminal device, FIG. 5 is a diagram illustrating the mobile terminal device viewed from the touch panel unit side, and FIG. 6 is a diagram illustrating the mobile terminal device including the pressure sensor unit. . The configurations shown in FIGS. 4, 5, and 6 are examples, and the present invention is not limited to such configurations. 4, FIG. 5 and FIG. 6, the same parts as those in FIG.

The mobile terminal device 20 includes hardware that implements the above-described functional unit (FIG. 3). As shown in FIG. 4, the processor 42, the sensor unit 44, the input unit 46, and the display unit 48 are provided. A voice input / output unit 50, a communication unit 52, and a storage unit 54.

The processor 42 executes an OS (Operating System) and an application program stored in the storage unit 54, and performs input control such as capturing of detection information from the sensor unit 44, detection of various information, calculation, display control, communication control, and the like. To do. The above-described functional unit (FIG. 3) is realized by the processor 42. The processor 42 constitutes an application activation unit that activates an application by pattern determination. In addition, an application activation unit that activates an application in the program storage unit 72 is configured.

The sensor unit 44 includes a touch panel unit 56, a pressure sensor unit 58, an acceleration sensor unit 60, a position sensor unit 62, and an angular velocity sensor unit 64. The touch panel unit 56 is installed on the front surface of the display unit 48 and detects a touch input by a finger or a touch pen. The pressure sensor unit 58 detects pressure applied to the touch panel unit 56 by a finger or a touch pen. The acceleration sensor unit 60 outputs acceleration information detected from a touch input of a finger or a touch pen. The position sensor unit 62 outputs position information (coordinate information) detected from touch input of a finger or a touch pen. The angular velocity sensor unit 64 detects the angular velocity of the mobile terminal device 20 and outputs the angular velocity information.

The input unit 46 inputs sensor information of the sensor unit 44 to the processor 42 under the control of the processor 42.

The display unit 48 is installed behind the touch panel unit 56, and displays input buttons assigned to the touch panel unit 56 and output information under the control of the processor 42.

The voice input / output unit 50 includes a microphone 66 as voice input means and a receiver 68 as voice output means. The voice input / output unit 50 takes in voice from the microphone 66 and reproduces voice from the receiver 68 under the control of the processor 42.

The communication unit 52 includes an antenna 70, and executes communication with the radio base station under the control of the processor 42. The communication unit 52, together with the processor 42, constitutes an end call function unit for terminating a call and a login function unit for logging in to a website based on pattern determination.

The storage unit 54 includes a program storage unit 72, a data storage unit 74, and a RAM (Random-Access Memory) 76. The program storage unit 72 stores the OS and application programs described above, and examples of the application program include an operation detection program, a lock program, and an unlock program. The data storage unit 74 includes a pattern registration unit, and a pattern to be compared with the input pattern is registered in the pattern registration unit. The RAM 76 constitutes a work area for various processes such as registration and determination of patterns recognized from input strokes.

In this portable terminal device 20, as shown in FIG. 5, a touch panel unit 56 is installed together with a display unit 48 on the front surface of a casing 78. A microphone 66 and a receiver 68 are installed in the housing 78 with the display unit 48 interposed therebetween.

As shown in FIG. 6, a pressure sensor unit 58 is installed on the back side of the touch panel unit 56. When the abdomen of the finger 80 is touched on the upper surface of the touch panel unit 56 and pressure P is applied via the touch panel unit 56, the pressure P is detected by the pressure sensor unit 58. This detection output is output as an electrical signal representing pressure information, and the level represents the pressure level.

Next, refer to FIGS. 7, 8 and 9 for the touch panel section and touch input. FIG. 7 is a diagram showing the touch panel unit, FIG. 8 is a diagram showing the touch panel unit and point movement, and FIG. 9 is a diagram showing detection points where the point movement is detected.

As shown in FIG. 7, a plurality of rows and a plurality of columns of addresses are set on the panel surface 82 of the touch panel unit 56. In this embodiment, detection points 84 of 12 rows and 10 columns are set. That is, the detection points 84 in 12 rows and 10 columns constitute an example of the position sensor 62. Alphabets a, b... L represent rows (X coordinates), and

numerals

1, 2,... 10 represent columns (Y coordinates).

Therefore, as shown in FIG. 8, a spiral stroke 86 is drawn on the panel surface 82 of the touch panel unit 56 as an example of touch input using a finger or a touch pen, thereby generating a point locus 88. . In this case, the stroke 86 is an example of an input operation that the user does not perform unconsciously.

The stroke 86 starts from the upper right portion of the touch panel portion 56, moves in a curved shape from the start point 90 toward the center portion, forms a revolving portion 92 at the center portion, and forms a cross portion 94. The curve moves from the portion 94 to the lower left and forms an end point 96 at the lower left. This point trajectory 88 starts at the point 9b and reaches the point 8b-7b-7c-6c-5c-5d-4d-3e. The point 4e is the point of inflection and the points 4e-4f-4g-5g-6g -7g-7f, point 7f as an inflection point, point 7e-6e-5e-5f-4f, point trajectory 88 crosses at this point 4f, and from point 4f to 4g-3g-3h-2i- 2j-2k-2l is reached, and the point 2l is the end point 96. That is, the point locus 88 is written on a diagonal line starting from the upper right corner portion side of the panel surface 82 and directed to the lower left corner portion side, and forms a cross portion 94 together with the circulating portion 92 in the intermediate portion.

Then, the point locus 88 corresponding to the stroke 86 is detected by a plurality of continuous detection point rows on the panel surface 82 as shown in FIG. That is, the point locus 88 corresponds to the detection points 9b-8b-7b-7c-6c-5c-5d-4d-3e-4e-3f-4f-5g-6g-7g-7f-7e-6e-5e-5f-4f. -4g-3g-3h-2h-2i-2j-2k-2l. In this point locus 88, the detection point 4f is detected twice with a time difference Δt, and the cross portion 94 exists on the point locus 88 from the start point 90 to the end point 96 with this detection. I understand.

The point locus 88 corresponding to the stroke 86 constitutes the pattern 98. That is, the pattern 98 is recognized as the stroke 86 of the touch input as an aggregate of the point locus 88. A plurality of

detection points

6a, 7a, 8a, 9a, 10a, 4b, 5b, 6b, 10b, 3c, 4c, 8c, 9c, 10c, 2d, 3d, 6d, 7d, 8d, which surround the

pattern

98, 2e, 8e, 2f, 6f, 8f, 1g, 2g, 8g, 1h, 4h, 5h, 6h, 7h, 8h, 1i, 3i, 4i, 1j, 3j, 1k, 3k, 1l, 3l An approximate range pattern 100 is formed. In this case, the pattern 98 is represented by diagonal lines, and the pattern 100 is represented by an encircling line consisting of a thick solid line.

With such a configuration, it is possible to recognize the pattern 98 by using the touch position and the touch point which are physical information of the determination element of the touch input for the stroke 86 which is not operated unconsciously. In addition, the pattern 100 which is the vicinity range is recognized by the range of the above-described detection points 6a to 3l around the pattern 98 and the detection points (including the detection point 6f in this case) inside the circulating portion 92. Can do. These

patterns

98 or 100 may be registered.

Next, with reference to FIG. 10, FIG. 11, FIG. 12, and FIG. 13 for position detection of touch input, acceleration calculation, pressure calculation, and angular velocity calculation. FIG. 10 is a flowchart showing the position detection processing procedure, FIG. 11 is a flowchart showing the acceleration calculation processing procedure, FIG. 12 is a flowchart showing the pressure calculation processing procedure, and FIG. 13 shows the angular velocity calculation processing procedure. It is a flowchart.

The touch input position detection processing procedure is a process of detecting a touch position or locus on the touch panel unit 56 and outputting position information representing the position or locus.

In this processing procedure, as shown in FIG. 10, the touch panel unit 56 is touched with a finger or a touch pen (step S111). Position information on the X axis and the Y axis, which are coordinate axes representing the touch position on the touch panel unit 56, is detected (step S112), and position information that is a determination element for touch input is output (step S113).

Next, the processing procedure for calculating touch input acceleration is processing for calculating acceleration from position information representing the position and locus of touch on the touch panel unit 56.

In this processing procedure, as shown in FIG. 11, the touch of the finger or the touch pen on the touch panel unit 56 and the position thereof are monitored (step S121). If a finger or a touch pen is touching the touch panel unit 56 (YES in step S121), X-axis and Y-axis position information indicating the touch position of the touch panel unit 56 is detected (step S122). Whether the position information has changed is monitored (step S123). If the position information has changed (YES in step S123), X-axis and Y-axis position information indicating the touch position of the touch panel unit 56 is detected (step S124). An acceleration is calculated from the position information (step S125), and an acceleration that is a determination element for touch input is output (step S126).

If the X-axis and Y-axis position information representing the touch position on the touch panel unit 56 has not changed (NO in step S123), the acceleration is not calculated, and this process ends.

Next, the processing procedure for calculating the pressure of the touch input is a process of detecting the position and locus of the touch on the touch panel unit 56 and outputting the pressure representing the position and locus.

In this processing procedure, as shown in FIG. 12, the touch of the finger or the touch pen on the touch panel unit 56 and the position thereof are monitored (step S131). The pressure of the part in contact with the touch panel unit 56 is calculated (step S132), and the pressure that is the touch input determination element is output (step S133). In this embodiment, it is determined whether or not the calculated pressure is output in step S133, and if it is not output, the process returns to step S131, but may be output without making such a determination.

Next, the processing procedure for calculating the angular velocity of the touch input is a process of monitoring the movement of the mobile terminal device and calculating the angular velocity.

As shown in FIG. 13, this processing procedure monitors whether the portable terminal device 20 is stationary (step S141). If the portable terminal device 20 is not stationary (NO in step S141), the mobile terminal device 20 is moved from the movement to the portable terminal device. The angular velocity of the terminal device 20 is calculated (step S142). If the mobile terminal device 20 is stationary (YES in step S141), the angular velocity Vθ of the mobile terminal device 20 is zero (Vθ = 0) (step S143).

Then, the angular velocity Vθ or Vθ = 0 is output as physical information that is a determination element (step S144).

According to such a configuration, a touch position, acceleration, pressure, and angular velocity are obtained as physical information that is a determination element of touch input, and a touch input pattern can be recognized from the physical information.

Next, FIG. 14 will be referred to regarding the lock setting of the mobile terminal device. FIG. 14 is a flowchart illustrating a lock setting process.

This lock setting processing procedure recognizes the touch input pattern using the above-described physical information obtained from the touch input to the touch panel unit 56 for the lock setting, and sets the registered pattern as the release information.

Therefore, in this processing procedure, as shown in FIG. 14, it is determined whether or not the lock is set (step S201). If the lock is not set (NO in step S201), the process ends.

If it is a lock setting (YES of step S201), pattern registration mode will be started and pattern registration will be performed (step S202). It is determined whether or not the pattern has been registered (step S203). If the pattern is not registered (NO in step S203), this process ends. If the pattern is registered (YES in step S203), lock setting is executed (step S204). Since this lock setting is related to pattern registration by touch input, it is necessary for the registration pattern and the input pattern to coincide with each other in order to cancel the lock setting.

Next, referring to FIG. 15 for pattern registration processing. FIG. 15 is a flowchart showing a processing procedure during registration.

This pattern registration processing procedure is a process of registering a touch input pattern for the touch panel unit 56 when setting a function lock or the like. The registered pattern is used for user authentication processing for unlocking.

In this processing procedure, as shown in FIG. 15, the position information of the X axis and the Y axis representing the point where the finger is placed on the touch panel unit 56 is detected (step S211). It is determined to which range the position of the point corresponds (step S212). The pressure from the finger or the touch pen is calculated (step S213). The movement of the point is monitored (step S214). If there is a movement of the point (YES in step S214), the acceleration of the point movement is calculated or the movement speed of the point is calculated from the movement of the position of the point (step S215).

In this case, a pattern is generated by the position information, pressure, and acceleration of the touch input (step S216), this pattern is registered in the pattern registration unit (step S217), and the process returns to step S202 of the main routine (FIG. 14). Then, lock setting is executed.

Next, FIG. 16 will be referred to regarding the unlocking process. FIG. 16 is a flowchart showing the unlocking procedure.

This unlock process is a process for unlocking when there is a registered pattern as unlock information.

In this processing procedure, as shown in FIG. 16, it is determined whether or not the lock is released (step S221). If the lock is not released (NO in step S221), this process is terminated. If the lock is released (YES in step S221), the above-described touch input is performed (step S222). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

It is determined whether the input pattern obtained by touch input matches the registered pattern (step S223). If the input pattern matches the registered pattern (YES in step S223), the lock is released (step S224). If the input pattern does not match the registered pattern (NO in step S223), the lock cannot be released. (Step S225). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

Therefore, FIG. 17 will be referred to regarding this unlocking process. FIG. 17 is a flowchart illustrating an example of a specific processing procedure for unlocking.

In this processing procedure, in the case of unlocking, as shown in FIG. 17, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S231). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range (1a to 10l) the position of the point corresponds (step S232). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S233). For example, when the point 9b is registered, it is determined whether the point 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not correspond to the coordinate range of the position of the point (NO in step S233), the lock cannot be released (step S234).

In this determination, if the coordinate range of the position of the point falls (YES in step S233), as a second determination whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step (step S233). S235). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] × 0.8 to XX [N] × 1.2. Is determined (step S236). In this pressure determination, if the pressure does not fall within the predetermined pressure range (NG in step S236), the lock cannot be released (step S237).

If such pressure determination is within a predetermined pressure range (OK in step S236), the movement of the point is monitored (step S238). If there is a movement of the point (YES in step S238), an acceleration is calculated from the movement of the position distance of the point, and this acceleration is compared with the registered pattern for determination (step S239). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is within a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S240). If this acceleration is outside the predetermined range (NG in step S240), the lock cannot be released (step S241).

If this acceleration is within a predetermined range (OK in step S240), the lock is released (step S242), and this process is terminated.

By using a pattern that recognizes the above-described physical information obtained from touch input as a determination element in this way, if the lock is set and unlocked, it is possible to prevent unlocking by an unconscious operation of the user. Moreover, security can be improved.

Next, with reference to FIG. FIG. 18 is a flowchart showing the processing procedure for setting the end call.

This end-call setting processing procedure recognizes the touch input pattern using the above-described physical information obtained from touch input to the touch panel unit 56 for the end-call processing as a determination element, and sets the registered pattern as end-call information.

Therefore, in this processing procedure, as shown in FIG. 18, it is determined whether or not the end of the call is set (step S301). If the end of call is not set (NO in step S301), this process ends.

If it is the end call setting (YES in step S301), the pattern registration mode is activated and pattern registration is performed (step S302). It is determined whether or not the pattern is registered (step S303). If the pattern is not registered (NO in step S303), this process is terminated. If the pattern is registered (YES in step S303), the end of call setting process is executed (step S304). Since this end-call setting process is related to pattern registration by touch input, it is necessary for the end-call setting process to match the registered pattern and the input pattern.

Next, referring to FIG. 19 for pattern registration processing for setting the end of call. FIG. 19 is a flowchart showing a pattern registration processing procedure.

In this processing procedure, as shown in FIG. 19, position information on the X axis and the Y axis representing the point where the finger is placed on the touch panel unit 56 is detected (step S311). It is determined to which range the position of the point corresponds (step S312). The pressure from the finger or the touch pen is calculated (step S313). The movement of the point is monitored (step S314). If there is a movement of the point (YES in step S314), the acceleration of the movement of the point is calculated or the movement speed of the point is calculated from the movement of the position of the point (step S315).

In this case, a pattern is generated by the position information, pressure, and acceleration of the touch input (step S316), this pattern is registered in the pattern registration unit (step S317), and the process returns to step S302 of the main routine (FIG. 18). Then, the end call setting is executed.

Next, referring to FIG. FIG. 20 is a flowchart showing the processing procedure of the end talk.

This end story processing procedure is the end story processing when a registered pattern exists as the end story information.

In this processing procedure, as shown in FIG. 20, it is determined whether or not a call is in progress (step S321). If the call is not in progress (NO in step S321), this process ends. If the call is in progress (YES in step S321), touch input is performed for the end of the call (step S322). Recognize patterns from touch input. That is, the touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

It is determined whether the input pattern obtained by touch input matches the registered pattern (step S323). If the input pattern matches the registered pattern (YES in step S323), the end of call lock is released (step S324), and the end of call process is executed (step S325). If the input pattern does not match the registered pattern (NO in step S323), the end-of-call lock cannot be released (step S326). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

Therefore, referring to FIG. FIG. 21 is a flowchart illustrating an example of a specific processing procedure for unlocking.

In this processing procedure, in the case of the end-call processing, as shown in FIG. 21, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S331). As a first determination between the input pattern and the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S332). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S333). For example, when the point 9b is registered, it is determined whether the point 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not correspond to the coordinate range of the position of the point (NO in step S333), the call cannot be ended (step S334).

In this determination, if it falls within the coordinate range of the position of the point (YES in step S333), as a second determination between the input pattern and the registered pattern, the pressure is compared with the registered pattern for determination (step S335). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] × 0.8 to XX [N] × 1.2. Determine whether. In this pressure determination, if it does not fall within the predetermined pressure range (NG in step S336), the call cannot be ended (step S337).

If such a pressure determination is within a predetermined pressure range (OK in step S336), the movement of the point is monitored (step S338). An acceleration is calculated, and this acceleration is compared with a registered pattern for determination (step S339). For example, if the acceleration of the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S340). If this acceleration is outside the predetermined range (NG in step S340), the end of speech is impossible (step S341).

If the acceleration is within the predetermined range (OK in step S240), the call lock is released, the call ending process is executed (step S342), and the process ends.

As described above, by using a pattern that recognizes at least two types of physical information obtained from touch input as a determination element, it is possible to prevent end-of-call processing or end-of-call.

[Third Embodiment]

The third embodiment has a function of recognizing a touch input pattern using five types of physical information obtained from touch input as a determination element and determining whether the input pattern matches the registered pattern or the vicinity thereof. Have

FIG. 22 is referred to for the third embodiment. FIG. 22 is a flowchart illustrating a lock setting process. The configuration shown in FIG. 22 is an example, and the present invention is not limited to such a configuration.

This processing procedure is a lock setting for the mobile terminal device as in the second embodiment, and is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

In this processing procedure, five types of determination elements are used as the above-described physical information obtained from the touch input: the number of points of the touch input, the position of the point, the acceleration of the point, the moving angle, and the pressure. That is, in this processing procedure, as shown in FIG. 22, determination of lock setting (step S401), touch input (steps S402, S403, S404, S405, S406), pattern registration (step S407), and lock setting (step S408). )It is included.

Therefore, in this processing procedure, it is determined whether or not lock setting is to be performed (step S401). If lock setting is not to be performed (NO in step S401), this processing is terminated. If the lock is set (YES in step S401), the process proceeds to touch input. As the first touch input, the number of points where the finger is first placed on the touch panel unit 56 (FIGS. 4 and 5) is detected, and the number of points is obtained as a determination element of the touch input (step S402).

Next, the position of a point on the touch panel unit 56 (FIG. 4) is detected as the second touch input, and the position information (X, Y) is obtained as a determination element of the touch input (step S403).

Next, as the third touch input, the acceleration at which the point moves is detected, and the acceleration is obtained as a determination element of the touch input (step S404).

Next, as the fourth touch input, an angle at which the point moves is detected, and the angle is obtained as a touch input determination element (step S405).

Next, as a fifth touch input, a change in pressure for pressing the touch panel unit 56 (FIG. 6) with a finger is detected, and a pressure change is obtained as a determination element for the touch input (step S406).

In this way, a pattern is generated using the five types of physical information of the number of points, position, acceleration, angle, and pressure change as determination elements, and this pattern is set in the data storage unit 74 (FIG. 4). (Step S407).

After this pattern registration, lock setting is executed (step S408). The lock setting executed together with pattern registration cannot be unlocked unless there is an input pattern that matches the registered pattern.

Referring to FIG. 23 and FIG. 24 for the touch input used for this lock setting. FIG. 23 is a diagram illustrating an input operation, and FIG. 24 is a diagram illustrating a touch input.

In the mobile terminal device 20, for example, as shown in FIG. 23, as the touch input that is not operated unintentionally by a person, the index finger 102 is brought into contact with the upper left side of the touch panel unit 56, and the tip of the thumb 104 is brought into contact with the lower right side. While maintaining the contact state, the index finger 102 is turned to the arrow a and the thumb 104 is turned to the arrow b. According to such touch input, two separated points and a determination element based on the movement can be obtained.

As shown in FIG. 24, 0 to 60 detection points are set in the X-axis direction and 0 to 90 detection points are set in the Y-axis direction on the touch panel unit 56 of the mobile terminal device 20. Point A, point A ′, and arrow a indicate the pressing point of the index finger 102 and its movement locus, and point B, point B ′, and arrow b indicate the pressing point of the thumb 104 and its movement locus. In this case, as position information of A → A ′, A → A ′ = {X _A (= 10), Y _A (= 25)} → {X _A ′ (= 50), Y _A ′ (= 25)} Is obtained. As position information of B → B ′, B → B ′ = {X _B (= 50), Y _B (= 65)} → {X _B ′ (= 10), Y _B ′ (= 65)} is obtained. .

Referring to FIG. 25 and FIG. 26 for other touch inputs used for lock setting. FIG. 25 is a diagram illustrating another touch input, and FIG. 26 is a diagram illustrating another input operation.

For example, as shown in FIG. 25, in the portable terminal device 20, as shown in FIG. 25, the tip of the index finger 102 is brought into contact with the upper right side of the touch panel unit 56, and the index finger 102 is placed in Japan while maintaining the contact state. Move to draw the kana character "no" of the word. According to such touch input, a determination element of touch input by a stroke 86 (FIG. 8) of one stroke can be obtained.

In this touch input, as shown in FIG. 26, 0 to 60 detection points are set in the X-axis direction and 0 to 90 detection points are set in the Y-axis direction on the touch panel unit 56, and position information is obtained from these detection points. Is obtained. In this case, if the start point is C point and the end point is D point, C → D = {X _C (= 50), Y _C (= 25)} → {X _D (= 10) ), Y _D (= 65)}.

Refer to FIG. 27, FIG. 28 and FIG. 29 for the touch input determination element. FIG. 27 is a diagram showing a change in acceleration of a touch input, FIG. 28 is a diagram showing an angle range of the touch input, and FIG. 29 is a diagram showing a pressure change in the touch input.

For example, as shown in FIG. 27, acceleration changing with time is detected between the start point 106 and the end point 108 of the touch input. This acceleration is one piece of physical information and can be used as a touch input determination element.

The touch input angle θ can be determined as a touch input determination element, for example, as shown in FIG. In this case, using the intersection point of the X axis and the Y axis set in the touch panel unit 56 as a reference point, the angle θ formed by the aforementioned points A and A ′ of the touch input is obtained. In this case, the angle θ formed by point A and point A ′ is 35 °.

Further, for example, a pressure that changes with time is detected between the start point 106 and the end point 108 of the touch input as shown in FIG. This pressure change is one piece of physical information and can be used as a determination element for touch input.

For other touch inputs, refer to FIG. 30 and FIG. FIG. 30 is a diagram illustrating another input operation, and FIG. 31 is a diagram illustrating another touch input.

Although the movement of the point (FIGS. 23 and 24) and the stroke (FIGS. 25 and 26) are exemplified as the touch input, the present invention is not limited to this. The touch input may be a character input. As shown in FIG. 30, for example, the alphabet finger “ON” may be drawn by bringing the index finger 102 into contact with the touch panel unit 56, and this character “ON” is used as a touch input determination element as shown in FIG. 31. Position information on the X axis and the Y axis of the touch panel unit 56 is obtained.

With the above configuration, it is possible to acquire a plurality of physical information such as the number of points, position, acceleration, moving angle, pressure change, etc., from a touch input by a single operation such as one stroke. As a result, a combination of five types of physical information is obtained, and a touch input pattern can be generated by logical combination of these combinations, for example. If a plurality of physical information is acquired, two or more kinds of physical information can be selected and a pattern can be generated.

Next, with respect to unlocking, FIG. 32 is a flowchart showing the unlocking processing procedure.

This processing procedure is the unlocking process corresponding to the above-described lock setting (FIG. 22). In this processing procedure, as described above, the lock setting is as described above. As the physical information described above obtained by touch input, the five types of determination elements of touch input point number, point position, point acceleration, moving angle, and pressure are used. Is used. Therefore, in this processing procedure, as shown in FIG. 32, determination of unlocking (step S411), touch input (steps S412, S413, S414, S415, S416), pattern determination (step S417), and unlocking are impossible. (Steps S418 and S419) are included.

Therefore, in this processing procedure, it is determined whether or not the lock is released (step S411). If the lock is not released (NO in step S411), the process is terminated. In the case of unlocking (YES in step S411), the process proceeds to touch input. As the first touch input, the number of points where the finger is first placed on the touch panel unit 56 (FIGS. 4 and 5) is detected, and the number of points is obtained as a determination element of the touch input (step S412).

Next, the position of the point on the touch panel unit 56 (FIG. 4) is detected as the second touch input, and the position information (X, Y) is obtained as the determination element of the touch input (step S413).

Next, as the third touch input, the acceleration at which the point moves is detected, and the acceleration is obtained as a touch input determination element (step S414).

Next, as the fourth touch input, an angle at which the point moves is detected, and the angle is obtained as a touch input determination element (step S415).

Next, as a fifth touch input, a change in pressure for pressing the touch panel unit 56 (FIG. 6) with a finger is detected, and a pressure change is obtained as a determination element for the touch input (step S416).

In this way, a pattern is generated using the five types of physical information of the number of points, position, acceleration, angle, and pressure change as judgment elements, and this input pattern matches the registered pattern in the data storage unit 74 (FIG. 4). It is determined whether or not to perform (step S417).

After this pattern determination, if the input pattern matches the registered pattern (YES in step S417), unlocking is executed (step S418). If the input pattern does not match the registered pattern (NO in step S417), the lock cannot be released (step S419).

With the above configuration, the number of touch input points, position, acceleration, moving angle, and change in pressure are detected as physical information, and the touch input pattern is recognized by the logical product of these and registered. Each is characteristic physical information, and a pattern is generated by a plurality of these logical products. For this reason, the determination accuracy between the registered pattern and the input pattern can be improved, touch input due to the unconsciousness of the user can be eliminated, and malfunction can be prevented.

[Fourth Embodiment]

The fourth embodiment is configured to prevent the user from unintentionally ending the call during a call by ending the end-of-call lock on the display screen after releasing the end-of-call lock. is there.

Referring to FIG. 33, FIG. 34 and FIG. 35 for the fourth embodiment. FIG. 33 is a flowchart showing the processing procedure of the end call, FIG. 34 is a view showing a display example of the inquiry display and selection button at the end of the call, and FIG. 35 is a view showing a display example of the end call.

The processing procedure of the end speech processing is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

This processing procedure includes a call lock by starting a call (step S501), a call lock release (steps S502, S503, S504, S505), and a call termination process (steps S506, S507).

Therefore, in this processing procedure, as shown in FIG. 33, the call is locked when the call starts (step S501). This lock setting may be performed, for example, in the lock setting (FIGS. 14 and 15) of the second embodiment.

During the call, the unlocked monitoring state is maintained (NO in step S502 and step S502). If the lock is released (YES in step S502), the user performs a touch input (step S503). This touch input is input by an operation that is not performed by the user unconsciously. As described above, the input pattern is recognized from this touch input, and it is determined whether the input pattern matches the registered pattern (step S504). . If the input pattern does not match the registered pattern (NO in step S504), the lock is maintained, so that touch input is required again (step S503).

If the input pattern matches the registered pattern (YES in step S504), the lock is released (step S505). When the lock is released, an end-of-speech operation is requested (step S506), and the end of the talk is made by this operation (step S507), and this process is terminated.

In the end speech operation (step S506), as shown in FIG. 34, an inquiry message 110 for the end speech operation and

selection buttons

112 and 114 are displayed on the display unit 48 by display control. For example, the message 110 displays “Do you want to end the call?”. The selection button 112 is a button for instructing an end story “YES”, and the selection button 114 is a button for instructing an end story rejection “NO”.

Therefore, if the user touches the selection button 112, the end-of-call process is performed by the touch input. If the selection button 114 is touched, the call termination is rejected by the touch input, and the call is maintained.

Then, when the end speech processing is executed, as shown in FIG. 35, a message 116 for notifying the end of speech is displayed on the display unit 48 by display control. This message 116 displays, for example, “Call ended”. As a result, the user can know that the end of the conversation has ended.

According to such a configuration, since there is an inquiry about the end-of-call process after unlocking, the user can know the release of the lock, and the user can end the call by recognizing the release of the lock. It is possible to prevent unscheduled endings due to user's unconscious operation or careless operation.

[Fifth Embodiment]

The fifth embodiment is a configuration in which touch input pattern determination is used to start an application program (application) in the program storage unit 72 (FIG. 4).

Referring to FIG. 36, FIG. 37, FIG. 38 and FIG. 39 for the fifth embodiment. FIG. 36 is a flowchart showing the processing procedure of application activation setting, FIG. 37 is a flowchart showing the processing procedure of pattern registration, FIG. 38 is a flowchart showing the processing procedure of application activation, and FIG. It is a flowchart which shows a specific process sequence. Also in this embodiment, the functional unit shown in FIG. 3 and the hardware configuration shown in FIG. 4 are used.

The processing procedure of this application activation setting is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. In this processing procedure, a touch input pattern is recognized by using the above-described physical information obtained from touch input to the touch panel unit 56 for application activation setting, and the registered pattern is set as application activation information.

Therefore, in this processing procedure, as shown in FIG. 36, it is determined whether the application activation setting is set (step S601), and if it is not the application activation setting (NO in step S601), the process is terminated.

If it is an application activation setting (YES in step S601), the pattern registration mode is activated and pattern registration is performed (step S602). It is determined whether pattern registration has been performed (step S603). If pattern registration is not performed (NO in step S603), this process ends. If the pattern is registered (YES in step S603), the application activation setting is executed (step S604). Since this application activation setting is associated with pattern registration by touch input, it is necessary that the registration pattern and the input pattern match for the application activation.

The pattern registration process used for starting the application is a process of registering a touch input pattern for the touch panel unit 56 in setting the application activation. The registered pattern is used for user authentication processing for starting an application.

Therefore, in this processing procedure, as shown in FIG. 37, position information on the X axis and the Y axis representing the point where the finger is placed on the touch panel unit 56 is detected (step S611). It is determined to which range the position of the point corresponds (step S612). The pressure from the finger or the touch pen is calculated (step S613). The movement of the point is monitored (step S614). If there is a movement of the point (YES in step S614), the acceleration of the movement of the point or the movement speed of the point is calculated from the movement of the position of the point (step S615).

In this case, a pattern is generated by the position information, pressure, and acceleration of the touch input (step S616), the pattern is registered in the pattern registration unit (step S617), and the process returns to step S602 of the main routine (FIG. 36). Then, the application activation setting is executed.

After the application activation setting is executed in this way, the application activation processing procedure requires that the input pattern matches the registered pattern by pattern recognition by touch input for application activation.

Therefore, in this application activation processing procedure, as shown in FIG. 38, it is determined whether the application is activated (step S621). If the application is not activated (NO in step S621), the process is terminated. If the application is activated (YES in step S621), the touch input described above is performed (step S622). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

It is determined whether the input pattern obtained by touch input matches the registered pattern (step S623). If the input pattern matches the registered pattern (YES in step S623), the application is activated (step S624). If the input pattern does not match the registered pattern (NO in step S623), the application cannot be activated. (Step S625). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

Therefore, in the specific processing procedure for starting the application, as shown in FIG. 39, whether the application is started is monitored (step S631), and if the application is started, touch input is performed. In this case, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S632). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S633). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, back, left and right (step S634). For example, when the point 9b is registered, it is determined whether the point 8a to 10a, 8b to 10b, and 8c to 10c are applicable. If this determination does not correspond to the coordinate range of the position of the point (NO in step S634), the application cannot be activated (step S635).

In this determination, if it falls within the coordinate range of the position of the point (YES in step S634), as a second determination of whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step) S636). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] × 0.8 to XX [N] × 1.2. Determine whether. If the pressure does not fall within the predetermined pressure range (NG in step S637), the application cannot be activated (step S638).

If such pressure determination is within a predetermined pressure range (OK in step S637), the movement of the point is monitored (step S639), and if there is a movement of the point (YES in step S639), the movement of the position of the point from An acceleration is calculated, and the acceleration is compared with a registered pattern for determination (step S640). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is within a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S641). If this acceleration is outside the predetermined range (NG in step S641), the application cannot be activated (step S642).

If this acceleration is within a predetermined range (OK in step S641), application activation is executed (step S643).

Since the application activation is permitted by using a pattern that recognizes at least two types of physical information obtained from touch input as a determination element in this way, the application activation when the input pattern does not match the registered pattern can be prevented. In addition, the application can be protected from free activation, and security can be increased.

[Sixth Embodiment]

In the sixth embodiment, touch input pattern determination is used for logging in to a website using a network communication function.

Referring to FIG. 40, FIG. 41, FIG. 42, and FIG. 43 for the sixth embodiment. FIG. 40 is a flowchart showing the processing procedure for login setting to the website, FIG. 41 is a flowchart showing the processing procedure for pattern registration, FIG. 42 is a flowchart showing the processing procedure for logging in to the website, and FIG. It is a flowchart which shows the specific process sequence of login to a website.

The processing procedure for setting login to this website is an example of the electronic device, the operation detection method, or the operation detection program of the present disclosure. In this processing procedure, the touch input pattern is recognized using the above-described physical information obtained from the touch input to the touch panel unit 56 for the login setting, and the registered pattern is set as the login information.

Therefore, in this processing procedure, as shown in FIG. 40, it is determined whether or not the login setting is set (step S701). If the login setting is not set (NO in step S701), the processing ends.

If it is login setting (YES in step S701), the pattern registration mode is activated and pattern registration is performed (step S702). It is determined whether or not the pattern has been registered (step S703). If the pattern is not registered (NO in step S703), this process ends. If the pattern is registered (YES in step S703), login setting is executed (step S704). Since this login setting is related to pattern registration by touch input, it is necessary for the login pattern to match the input pattern for login to the website.

The pattern registration process used for login is a process of registering a touch input pattern for the touch panel unit 56 at the time of login setting. The registered pattern is used for user authentication processing for login.

Therefore, in this processing procedure, as shown in FIG. 41, position information on the X axis and the Y axis representing the point where the finger on the touch panel unit 56 is placed is detected (step S711). It is determined to which part of the coordinate range the position of the point corresponds (step S712). The pressure from the finger or the touch pen is calculated (step S713). The movement of the point is monitored (step S714). If there is a point movement (YES in step S714), the acceleration of the point movement is calculated or the movement speed of the point is calculated from the position distance movement of the point (step S715).

In this case, a pattern is generated based on the position information, pressure, and acceleration of the touch input (step S716), the pattern is registered in the pattern registration unit (step S717), and the process returns to step S702 of the main routine (FIG. 40). Then, login settings are executed.

After the login setting is executed in this way, the login processing procedure requires that the input pattern matches the registered pattern by pattern recognition by touch input for login.

Therefore, in this login processing procedure, as shown in FIG. 42, it is determined whether or not the user is logged in (step S721). If not logged in (NO in step S721), the process is terminated. If it is login (YES in step S721), the touch input described above is performed (step S722). The touch input pattern is recognized using the above-described physical information obtained from the touch input as a determination element.

It is determined whether the input pattern obtained by touch input matches the registered pattern (step S723). If the input pattern matches the registration pattern (YES in step S723), login is executed (step S724). If the input pattern does not match the registration pattern (NO in step S723), login is disabled (step S723). S725). In this case, as described above, the match determination between the input pattern and the registered pattern may be determined by including the approximate range in the registered pattern.

Therefore, in the specific processing procedure of this login, as shown in FIG. 43, it is monitored whether it is a login (step S731), and if it is a login, touch input is performed. In this case, the position (X, Y) of the point where the finger or the touch pen is placed on the touch panel unit 56 is calculated (step S732). In this case, as a first determination as to whether the input pattern matches the registered pattern, it is determined to which part of the coordinate range the position of the point corresponds (step S733). That is, it is determined whether or not the position of the point at the time of registration falls within the range of front, rear, left and right (step S734). For example, when the point 9b is registered, it is determined whether the point 8a to 10a, 8b to 10b, and 8c to 10c are applicable. In this determination, if it does not fall within the coordinate range of the point position (NO in step S734), login to the site is disabled (step S735).

In this determination, if it falls within the coordinate range of the position of the point (YES in step S734), as a second determination of whether the input pattern matches the registered pattern, the pressure is compared with the registered pattern for determination (step (step S734). S736). For example, if the pressure at the point of registration is XX [N], the pressure is within a predetermined pressure range, for example, XX [N] × 0.8 to XX [N] × 1.2. Determine whether. If the pressure does not fall within the predetermined pressure range (NG in step S737), login is disabled (step S738).

If such a pressure determination is within a predetermined pressure range (OK in step S737), the movement of the point is monitored (step S739), and if there is a movement of the point (YES in step S739), the movement of the position of the point from An acceleration is calculated, and this acceleration is compared with a registered pattern for determination (step S740). For example, if the acceleration at the point at the time of registration is ΔΔ [cm / s ² ], the acceleration is within a predetermined range, for example, ΔΔ [N] × 0.8 to ΔΔ [N] × 1.2. It is determined whether it falls within the range (step S741). If this acceleration is outside the predetermined range (NG in step S741), login is disabled (step S742).

If the acceleration is within a predetermined range (OK in step S741), login is executed (step S743).

Since login is permitted by using a pattern that recognizes at least two types of physical information obtained from touch input as a determination element in this way, login when the input pattern does not match the registered pattern can be prevented. Moreover, free login can be prevented and security can be improved.

[Seventh Embodiment]

The seventh embodiment is a process of selecting whether an existing registration pattern is shared or a new pattern is registered.

Referring to FIG. 44 for this embodiment. FIG. 44 is a flowchart illustrating a lock setting process.

In this embodiment, as the lock setting, a process of selecting whether to register a registered pattern or to register a new pattern is used together, but such pattern registration is not limited to the lock setting.

Therefore, in this processing procedure, as shown in FIG. 44, it is determined whether or not the lock is set (step S801), and if the lock is not set, this processing ends.

If it is the lock setting, it is determined whether the registered pattern already registered is used for unlocking (step S802). If an existing registration pattern is used for unlocking (YES in step S802), lock setting is executed (step S803), and this process is terminated.

If an existing registered pattern is not used (NO in step S802), it is determined whether a new pattern is set (step S804). If no new pattern is set (NO in step S804), this process ends.

When a new pattern is set (YES in step S804), pattern registration is executed (step S805). Since the pattern registration is as described in the above embodiment, its description is omitted.

[Comparative example]

The comparative example is a portable terminal device having a malfunction prevention lock on the touch panel unit, and operates the call end button at the end of the call.

Referring to FIGS. 45 and 46 for this comparative example. FIG. 45 is a diagram illustrating a comparative example of the mobile terminal device, and FIG. 46 is a flowchart illustrating a processing procedure of the end call.

As shown in FIG. 45, the portable terminal device 220 has a touch panel unit 256 installed together with a display unit 248 on the front surface of a housing 278. A microphone 266 and a lock key 118 and a receiver 268 are installed on the housing 278 with the display unit 248 interposed therebetween, and an end button 120 is installed on the touch panel unit 256. The end button 120 is enabled after the touch panel lock is released by depressing the lock key 118, and the end operation can be performed.

Therefore, in the process of ending the call of the mobile terminal device 220, as shown in FIG. 46, a call is determined (step S901). If the call is not in progress (NO in step S901), the process ends.

If the call is in progress (YES in step S901), the malfunction prevention operation of the touch panel unit 256 is started. That is, when the user places the portable terminal device 220 on the ear, the touch panel unit 256 detects it and sets the touch panel lock (step S902). This touch panel lock is a process of blocking touch input to the touch panel unit 256 in order to prevent an end of talk due to careless touch input. In this case, the operation of the end call button 120 is invalid.

To end the talk, the lock key 118 is pressed (step S903), and the lock is released (step S904). With this unlocking, the touch input on the touch panel unit 256 and the operation of the call end button 120 become effective.

Therefore, when the end button 120 is selected (step S905) and pressed, the end of the call is reached (step S906).

In such a configuration, if the lock key 118 is inadvertently operated during a call, the touch panel unit 256 becomes effective, which may cause an unexpected end of the user. Moreover, even if the touch panel lock is automated, it can be easily released, so there is a disadvantage that malfunctions cannot be avoided by multiple operations. Such a problem is solved in the above embodiment or other embodiments described later, and a highly convenient portable terminal device is realized. In addition, according to the above-described embodiment, it is not necessary to install a lock release button, and mechanical switches and controls can be omitted, contributing to the compactness and simplification of the mobile terminal device.

[Other Embodiments]

(1) In the above embodiment, the touch input pattern is recognized using at least two types of physical information obtained from the touch input as determination elements. Examples of the physical information include the number of touch input points, position, speed, acceleration, angle, pressure, and angular velocity, but are not limited thereto. Therefore, the physical information may include any one of these or any of these.

(2) The pattern recognition may be based on the logical product of two or more types of physical information. As an example, the logical product of the touch position and acceleration (second embodiment: FIG. 11), the logical product of the number of touch points, its position, acceleration, angle and pressure (third embodiment: FIG. 22). Although the fourth embodiment: FIG. 32) is exemplified, the present invention is not limited to this. The logical product of physical information may be a combination of different types of physical information, and the physical information may be at least two types, and three or more types may be combined to generate a pattern by logical product.

(3) In the above embodiment, the acceleration sensor unit 60 is provided, but the present invention is not limited to this. A configuration may be used in which the velocity is obtained from the movement of the touch position per unit time, and the acceleration is calculated by differentiating the velocity.

(4) In the above embodiment, the angular velocity sensor unit 64 detects the angular velocity of the mobile terminal device 20, but is not limited to this. A sensor that detects the movement of the mobile terminal device 20 may be provided, and the angular velocity may be calculated from the sensor output. Moreover, it replaces with the angular velocity of the portable terminal device 20, and the angular velocity of the touch position with respect to the touch panel part 56 is calculated, and it is good also as physical information.

(5) In the above embodiment, the mobile terminal device 20 is illustrated as an example of the electronic device, but the electronic device of the present disclosure is not limited to this. Any electronic device capable of touch input may be used. For example, it may be a personal computer (PC) 320 (FIG. 47), a foldable mobile phone 420 (FIG. 48), a remote controller 520 (FIG. 49), or a game as long as it is an electronic device capable of touch input. It may be a device or an automobile engine starting device.

(6) As shown in FIG. 47, the PC 320 is configured such that the keyboard side casing 322 and the display side casing 324 can be folded by a hinge 326, and the display side casing 324 includes a display unit. 48 and the touch panel unit 56 are set. The touch panel unit 56 is configured according to the above-described embodiment, and can perform pattern recognition and pattern registration by the above-described processing from touch input. For this reason, also in this PC320, the same function as the said embodiment is implement | achieved and the effect can be acquired.

(7) The mobile phone 420 is an example of an electronic device or the mobile terminal device 20 described above. As shown in FIG. 48, the operation-side housing unit 422 and the display-side housing unit 424 include a hinge unit 426. The touch panel unit 56 is set in the display-side housing unit 424 together with the display unit 48. The touch panel unit 56 is configured according to the above-described embodiment, and can perform pattern recognition and pattern registration by the above-described processing from touch input. For this reason, this mobile phone 420 can realize the same functions as those in the above-described embodiment and obtain the effects. In this case, the keypad 428 is included in the input unit 46 (FIG. 4) described above.

(8) The remote controller 520 is means for remotely operating various electronic devices 522 such as a television receiver using radio waves or sound waves, as shown in FIG. Such a remote controller 520 can be equipped with the functions described for the electronic device or the mobile terminal device of the present disclosure, and the same functions and effects can be obtained.

(9) If the function of the present disclosure is installed in an automobile engine starter, the engine can be started with an input pattern that matches the pattern registered only by the user, and security can be improved.

(10) In the above embodiment, the point pressure [N] is exemplified (FIGS. 17, 21, 39, and 43), but is not limited thereto. As the pressure at the point, a pressure [Pa] obtained by dividing the force acting on the point by the area may be used.

As described above, the embodiments of the electronic device, the operation detection method, or the operation detection program of the present disclosure have been described, but the present invention is not limited to the above description. It goes without saying that various modifications and changes can be made by those skilled in the art based on the gist of the invention described in the claims or disclosed in the specification. It goes without saying that such modifications and changes are included in the scope of the present invention.

The electronic device, the operation detection method, or the operation detection program according to the present disclosure recognizes a pattern using at least two types of physical information obtained from touch input as a determination element, and performs pattern registration and input pattern determination. Therefore, the convenience of the device including the touch input unit is improved and useful.

2 Electronic equipment 4 Touch input unit 6 Pattern recognition unit 8 Pattern registration unit 10 Pattern determination unit 40 Lock control unit 42 Processor (application activation unit)
44 sensor unit 52 communication unit (end call function unit, login function unit)
54 storage unit 56 touch panel unit 58 pressure sensor unit 60 acceleration sensor unit 62 position sensor unit 64 angular velocity sensor unit 72 program storage unit 74 data storage unit

Claims

A touch input unit;
A pattern recognition unit that recognizes a pattern using at least two types of physical information obtained from touch input as a determination element;
If the pattern recognized by the pattern recognition unit matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or approximates the registered pattern A pattern determination unit that generates an output indicating that it matches the range;
An electronic device comprising:
The electronic device according to claim 1, wherein the physical information includes any one or any of touch input point number, position, velocity, acceleration, angle, pressure, angular velocity.
The electronic device according to claim 1, wherein the pattern recognition unit uses a logical product of two or more types of physical information as a determination element, and recognizes the pattern by the determination element.
Furthermore, a lock function unit for releasing the lock by the determination output of the pattern determination unit, an application activation unit for starting an application by the determination output of the pattern determination unit, and an end function unit for ending the call by the determination output of the pattern determination unit The electronic apparatus according to claim 1, further comprising: a login function unit configured to log in to a website based on a determination output of the pattern determination unit.
An operation detection method executed by an electronic device equipped with a touch input unit,
Recognizing a pattern using at least two types of physical information obtained from touch input as determination elements;
When the recognized pattern matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or matches the approximate range of the registered pattern Generating an output representative of
An operation detection method for an electronic device, comprising:
An operation detection program executed by an electronic device equipped with a touch input unit,
A function of recognizing a pattern using at least two types of physical information obtained from touch input as a determination element;
When the recognized pattern matches the registered pattern registered in advance in the registration unit or matches the approximate range of the registered pattern, it matches the registered pattern or matches the approximate range of the registered pattern A function that generates an output representing
An electronic device operation detection program comprising: