US20110205177A1 - Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation - Google Patents

Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation Download PDF

Info

Publication number
US20110205177A1
US20110205177A1 US13/126,075 US200913126075A US2011205177A1 US 20110205177 A1 US20110205177 A1 US 20110205177A1 US 200913126075 A US200913126075 A US 200913126075A US 2011205177 A1 US2011205177 A1 US 2011205177A1
Authority
US
United States
Prior art keywords
detecting
touch panel
acceleration
detected
portable device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/126,075
Other languages
English (en)
Inventor
Yutaka Nakai
Naoki Matsuo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyocera Corp
Original Assignee
Kyocera Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyocera Corp filed Critical Kyocera Corp
Assigned to KYOCERA CORPORATION reassignment KYOCERA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MATSUO, NAOKI, NAKAI, YUTAKA
Publication of US20110205177A1 publication Critical patent/US20110205177A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1643—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412—Digitisers structurally integrated in a display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • the present invention relates to a portable device, a method of detecting an operation, and a computer-readable storage medium storing a program for detecting an operation, and more particularly, to a portable device including a touch panel 5 , as well as a method of detecting an operation executed by such a portable device, and a computer-readable storage medium storing a program for detecting an operation executed by the same.
  • liquid crystal display hereinafter referred to as an “LCD”
  • touch panel 5 placed upon it.
  • the liquid crystal display displays an image including a plurality of keys, where touch panel 5 detects an indication for one of the keys and receives the input of a number or a character (see Patent Document 1, for example).
  • inputting alphabet, hiragana or katakana involves allocating a plurality of characters to a key and receiving the input of one of the characters depending on the number of times the key is depressed consecutively.
  • touch panel 5 is capable of detecting a position indicated, if an operation involving a plurality of indications in one and the same position is to be detected by touch panel 5 , the user must perform two operations: touching touch panel 5 with a finger and then lifting the finger off the panel each time the key is depressed. As a result, operations can be troublesome.
  • An object of the present invention is to provide a portable device capable of detecting an operation in which a user depresses a touch panel while continuously touching the touch panel.
  • Another object of the present invention is to provide a method of detecting an operation that allows detection of an operation in which a user depresses a touch panel while continuously touching the touch panel.
  • Yet another object of the present invention is to provide a computer-readable storage medium storing a program for detecting an operation that allows detection of an operation in which a user depresses a touch panel while continuously touching the touch panel.
  • a portable device includes: a touch panel; an acceleration sensor detecting an acceleration value; and a detecting means detecting a specified operation based on an acceleration value detected by the acceleration sensor while an indication is being detected by the touch panel.
  • a method of detecting an operation is performed by a portable device including a touch panel, including the steps of: detecting an acceleration value; and detecting a specified operation based on an acceleration value detected while an indication is being detected by the touch panel.
  • a program for detecting an operation stored in a computer-readable storage medium is executed by a portable device including a touch panel, for causing a computer to execute the steps of; detecting an acceleration value; and detecting a specified operation based on an acceleration value detected while an indication is being detected by the touch panel.
  • FIG. 1 is a perspective view of an external appearance of a mobile phone according to an embodiment of the present invention.
  • FIG. 2 is a functional block diagram showing an example of a set of functions of the mobile phone according to the present embodiment.
  • FIG. 3 is a functional block diagram schematically showing functions of the control unit.
  • FIG. 4 shows an example of a set of acceleration values A(n).
  • FIG. 5 shows an example of a set of primary differential values B(n).
  • FIG. 6 shows an example of a set of moving averages S(n).
  • FIG. 7 shows an example of a set of secondary differential values B(n).
  • FIG. 8 is a flow chart showing an example of a flow of a process for detecting an operation.
  • FIG. 1 is a perspective view of an external appearance of a mobile phone according to an embodiment of the present invention.
  • a mobile phone 1 which serves as a portable device, includes on its upper side an LCD 3 , a touch panel 5 placed upon LCD 3 , a speaker 7 comprising a receiver, and a microphone 9 . While the present embodiment shows a mobile phone 1 with an LCD 3 , LCD 3 may be replaced with an organic EL (electroluminescence) display.
  • Touch panel 5 may be a pressure-sensitive panel, in which case changes in pressure are sensed, or may be an electrostatic panel, where electric signals generated by static electricity are sensed. If an electrostatic touch panel 5 is used, touch panel 5 may be placed on the backside of LCD 3 .
  • the present embodiment uses an electrostatic panel.
  • touch panel 5 detects the position touched by the user with the finger as an indicated position. While the user is touching touch panel 5 with the finger, the panel outputs the detected indicated position to a control unit 11 . If the user continues to indicate one and the same position, the same indicated position is output continuously to control unit 11 .
  • an indicated position may be output to control unit 11 at predetermined time intervals white the user is touching touch panel 5 with the finger. In this case, too, control unit 11 can detect the user continuously touching touch panel 5 with the finger.
  • FIG. 2 is a functional block diagram showing an example of a set of functions of the mobile phone according to the present embodiment.
  • mobile phone 1 includes: a control unit 11 for controlling the entire mobile phone 1 ; a radio circuit 13 connected to an antenna 13 A; a codec unit 21 for processing audio data; a microphone 9 and a speaker 7 connected to codec unit 21 ; an LCD 3 ; a touch panel 5 ; a RAM (random-access memory) 15 used as a working area for control unit 11 ; an EEPROM (electronically erasable and programmable read-only memory) 17 for storing, for example, a program to be executed by control unit 11 ; an acceleration sensor 19 ; a vibration unit 23 ; and a card interface (I/F) 25 .
  • I/F card interface
  • Radio circuit 13 communicates wirelessly with a device at a base station connected to the communication network.
  • a radio signal sent by a device at a base station is received by antenna 13 A.
  • Radio circuit 13 receives the radio signal received by antenna 13 A, and outputs the radio signal demodulated into an audio signal to codec unit 21 .
  • Radio circuit 13 also receives an audio signal from codec unit 21 , and outputs the audio signal modulated into a radio signal to antenna 13 A.
  • the radio signal sent from antenna 13 A is received by a device at a base station.
  • Codec unit 21 decodes an audio signal input from radio circuit 13 , converts the decoded digital audio signal to an analog one, amplifies it, and outputs it to speaker 7 .
  • Codec unit 21 also receives an analog audio signal from microphone 9 , converts the audio signal to a digital one, encodes it, and outputs the encoded audio signal to radio circuit 13 .
  • a detachable flash memory 27 is mounted on card I/F 25 .
  • Control unit 11 can access flash memory 27 via card I/F 25 . While in the present embodiment a program to be executed by control unit 11 is stored in EEPROM 17 , a program may be stored in flash memory 27 , from which the program may be read and executed by control unit 11 .
  • Such a storage medium storing a program does not have to be flash memory 27 and may be a flexible disc, a cassette tape, an optical disc (CD-ROM (compact disc-ROM)/MO (magnetic optical disc)/MD (mini-disc)/DVD (digital versatile disc)), an IC card, an optical card, or a semiconductor memory such as a mask ROM, an EPROM (erasable programmable ROM), or an EEPROM (electronically EPROM).
  • mobile phone 1 may be connected to the Internet via radio circuit 13 , where a program may be downloaded from a computer connected to the Internet and be executed by control unit 11 .
  • a program does not have to be a program directly executable by control unit 11 , but also includes a source program, a compressed program, an encrypted program or the like.
  • Acceleration sensor 19 detects acceleration and outputs the detected acceleration value to control unit 11 .
  • the direction of the acceleration value detected by acceleration sensor 19 is the direction in which mobile phone 1 moves in a hand of the user who holds it when the user depresses touch panel 5 .
  • the acceleration value detected by acceleration sensor 19 is in the direction perpendicular to the surface of touch panel 5 . It should be noted that the direction perpendicular to the surface of touch panel 5 includes directions that are not exactly perpendicular due to a manufacturing error.
  • FIG. 3 is a function block diagram schematically showing functions of the control unit.
  • control unit 11 includes an indicated position receiving unit 51 that receives an indicated position from touch panel 5 , an operation detection unit 53 that detects a specified operation, a signal determining unit 55 that determines one signal out of a plurality of predetermined signals, and a display control unit 57 that controls the display on LCD 5 .
  • Display control unit 57 controls LCD 7 and displays an image on LCD 7 .
  • the present embodiment describes an image including a plurality of keys displayed on LCD 7 .
  • Display control unit 57 outputs, to signal determining unit 55 , key information including a pair of items: name and area, for each of the keys contained in the image displayed on LCD 7 .
  • Indicated position receiving unit 51 receives an indicated position output from touch panel 5 , and outputs the received indicated position to operation detection unit 53 and signal determining unit 55 . If the user continuously touches the surface of touch panel 5 , indicated position receiving unit 51 continuously outputs the indicated position to operation detection unit 53 and signal determining unit 55 as long as the user is touching touch panel 5 .
  • operation detection unit 53 detects an operation in which the user depresses touch panel 5 with a finger while continuously touching touch panel 5 with the finger.
  • the upper surface of mobile phone 1 which has touch panel 5 mounted on it, is pressed, such that mobile phone 1 is moved in space by the user's hand.
  • This movement may be a reciprocating motion in a direction generally perpendicular to the surface of touch panel 5 , or may be reciprocating motion back and forth in a circular orbit around a wrist. Since the distance of movement of such a reciprocating motion is very small, the movement of mobile phone 1 is in a direction generally perpendicular to touch panel 5 .
  • Operation detection unit 53 detects a reciprocating motion of mobile phone 1 based on an acceleration value input from acceleration sensor 19 while an indicated position is being input from indicated position receiving unit 51 , in order to detect an operation in which the user depresses touch panel 5 with a finger while continuously touching touch panel 5 with a finger.
  • operation detection unit 53 includes: an acceleration detecting unit 61 that receives an acceleration value output by acceleration sensor 19 ; a primary differential calculating unit 63 that differentiates acceleration values; a moving average calculating unit 65 that calculates the moving average of differentiated acceleration values; a secondary differential calculating unit 67 that differentiate moving averages; a local maximum extraction unit 69 that extracts a local maximum for moving averages; a local minimum extraction unit 71 that extracts a local minimum for moving averages; and a difference calculating unit 73 that calculates the difference between a local maximum and a local minimum.
  • Acceleration detecting unit 61 receives an indicated position from indicated position receiving unit 51 , and an acceleration value form acceleration sensor 19 . At predetermined intervals, acceleration detecting unit 61 samples an acceleration value output by acceleration sensor 19 while an indicated position is being input from indicated position receiving unit 51 , and outputs the sampled acceleration value to primary differential calculating unit 63 .
  • An acceleration value output by acceleration detecting unit 61 is denoted by A(n).
  • the variable n is a positive integer and denotes a sampling point.
  • acceleration detecting unit 61 resets the variable n to “1” and, when an indicated position is then input from indicated position receiving unit 51 , initiates sampling and outputs an acceleration value A(n).
  • FIG. 4 shows an example of a set of acceleration values A(n).
  • Primary differential calculating unit 63 differentiates acceleration values input from acceleration detecting unit 61 .
  • the value obtained by differentiating acceleration values once is referred to as a primary differential value B(n).
  • the primary differential value B(n) denotes a change in acceleration values A(n) and is suitably used for detecting a reciprocating motion of mobile phone 1 .
  • a primary differential value B(n) can be calculated by using the following equation (1):
  • Primary differential calculating unit 63 outputs the calculated primary differential value B(n) to moving average calculating unit 65 .
  • FIG. 5 shows an example of a set of primary differential values B(n).
  • the primary differential values B(n) shown in FIG. 5 are primary differential values calculated based on the acceleration values A(n) shown in FIG. 4 .
  • Moving average calculating unit 65 calculates a moving average of primary differential values B(n) for a predetermined time period.
  • a moving average is calculated in order to remove noise. Particularly, it can remove vibrations with shorter cycles than vibrations from an operation in which the user depresses touch panel 5 with a finger.
  • the moving average S(n) which is the average of six consecutive primary differential values, can be calculated by using the following equation (2):
  • Moving average calculating unit 65 outputs the calculated moving average S(n) to secondary differential calculating unit 67 , local maximum extraction unit 69 and local minimum extraction unit 71 .
  • FIG. 6 shows an example of a set of moving averages S(n).
  • the moving averages S(n) shown in FIG. 6 are moving averages calculated from the primary differential values B(n) shown in FIG. 5 .
  • a moving average is the average of six consecutive primary differential values
  • the number of primary differential values that are moving-averaged can be determined by the time period suitable for the detection of changes in acceleration due to an operation in which the user depresses touch panel 5 with a finger while continuously touching touch panel 5 with the finger, and by the sampling cycle.
  • the time period suitable for the detection of changes in acceleration due to an operation in which the used depresses touch panel 5 with a finger while continuously touching touch panel 5 with the finger can be determined by an experiment.
  • Secondary differential calculating unit 67 differentiates moving averages.
  • the value obtained by differentiating moving averages once is referred to as a secondary differential value C(n).
  • the secondary differential value C(n) can be calculated by using the following equation (3):
  • Secondary differential calculating unit 67 outputs the calculated secondary differential value C(n) to local maximum extraction unit 69 and local minimum extraction unit 71 .
  • FIG. 7 shows an example of a set of secondary differential values B(n).
  • the secondary differential values C(n) shown in FIG. 7 are secondary differential values calculated based on the moving averages S(n) shown in FIG. 6 .
  • a secondary differential value C(n) is calculated in order to obtain an extremum of moving averages S(n).
  • the sampling point at which the secondary differential value C(n) is closest to “0” indicates an extremum of moving averages S(n).
  • Secondary differential calculating unit 67 outputs, to local maximum extraction unit 69 and local minimum extraction unit 71 , the variable n that indicates the sampling point at which the secondary differential value C(n) comes closest to “0”.
  • the sampling point at which the secondary differential value C(n) comes closest to “0” is denoted by N.
  • Local maximum extraction unit 69 receives a moving average S(n) from moving average calculating unit 65 , and a sampling point N from secondary differential calculating unit 67 .
  • Local maximum extraction unit 69 extracts a large extremum from moving averages S(n). Specifically, if the moving average S(N) at the sampling point N input from secondary differential calculating unit 67 is larger than the preceding moving average S(N ⁇ 1), it is regarded as a local maximum. If the moving average S(N) at the sampling point N is regarded as a local maximum, local maximum extraction unit 69 outputs the moving average S(N) as a local maximum to difference calculating unit 73 .
  • Local minimum extraction unit 71 receives a moving average S(n) from moving average calculating unit 65 , and a sampling point N from secondary differential calculating unit 67 .
  • Local minimum extraction unit 71 extracts a local minimum from moving averages S(n). Specifically, if the moving average S(N) at the sampling point N input from secondary differential calculating unit 67 is smaller than the preceding moving average S(N ⁇ 1), it is regarded as a local minimum. If the moving average S(N) at the sampling point N is regarded as a local minimum, local minimum extraction unit 71 outputs the moving average S(N) as a local minimum to difference calculating unit 73 .
  • Difference calculating unit 73 receives the local maximum from local maximum extraction unit 69 , and the local minimum from the local minimum extraction unit. Difference calculating unit 73 calculates the difference between the maximum and the minimum and compares the calculated difference with a threshold value. If the calculated difference is equal to or larger than the threshold value, difference calculating unit 73 detects an operation in which the user depresses touch panel 5 with a finger while continuously touching the panel (hereinafter referred to as a “depressing operation”), and outputs to signal determining unit 55 a signal indicating that a depressing operation has been input.
  • the threshold value is a predetermined value and can be obtained by an experiment.
  • the threshold may be the smallest absolute value of the primary differential value of the acceleration values generated at that moment.
  • Signal determining unit 55 receives key information from display control unit 57 , an indicated position from indicated position receiving unit 51 , and a signal indicating that a depressing operation has been input from difference calculating unit 73 .
  • Signal determining unit 55 detects an indication by the user of one of the keys contained in the image displayed on LCD 7 based on the key information input from display control unit 57 and the indicated position input from indicated position receiving unit 51 .
  • the description below will be made for three alphabetic characters: “A”, “B” and “C” allocated to the key indicated by the user.
  • signal determining unit 55 While an indicated position indicating the position of the key to which the three alphabetic characters are allocated is being continuously input from indicated position receiving unit 51 , signal determining unit 55 counts the number of times a signal indicating that a depressing operation has been input is input from difference calculating unit 73 .
  • a key table that associates the alphabetic characters allocated to the keys contained in the image displayed on LCD 3 with the numbers of indications is stored in EEPROM 17 beforehand.
  • Signal determining unit 55 refers to the key table to determine a character, which depends on the key identified by the indicated position and the number counted.
  • the unit selects the character “A” out of the characters “A”, “B” and “C” if a signal indicating that a depressing operation has been input is input once, selects the character “B” if such a signal is input twice, and selects the character “C” if such a signal is input three times.
  • Each time signal determining unit 55 selects a character it determines the selected character as the character to be displayed, for example, stores it in a predetermined area of RAM 15 and displays it in a predetermined area of LCD 3 .
  • FIG. 8 is a flow chart showing an example of a flow of a process for detecting an operation.
  • the operation detecting process is executed by control unit 11 included in mobile phone 1 , where control unit 11 executes an operation detecting program.
  • control unit 11 is on standby (NO at step S 01 ) until it detects an indication that the user touches touch panel 5 , and when it detects an indication that the user touches touch panel 5 (YES at step 01 ), the process proceeds to step S 02 .
  • control unit 11 detects an indication that the user touches touch panel 5 .
  • the operation detecting process is executed on condition that the user touches touch panel 5 .
  • the variable n is set to “1” and the other variables are initialized.
  • the variables that are initialized at this moment include the stop counter C 1 , the operation counter C 2 , the local maximum MAX, the local minimum MIN, the array of acceleration values A(n), the array of primary differential values B(n), the array of moving averages S(n), and the array of secondary differential values C(n); they are set to “0”.
  • step S 03 the acceleration value output by acceleration sensor 19 is acquired, and the array of acceleration values A(n) is set to the acquired acceleration values.
  • step S 04 it is determined whether an indication that the user touches touch panel 5 has been detected, similar to step S 01 . If an indication by the user has been detected, the process proceeds to step S 05 ; if not, the process ends. That is, the operation detection process detects an operation in which the user depresses touch panel 5 with a finger from the moment the user's finger gets in contact with touch panel 5 until it lifts off touch panel 5 .
  • step S 05 it is determined whether the variable n is larger than “2”. If the variable n is larger than “2”, the process proceeds to step S 06 ; if not, the process proceeds to step S 22 . Step S 06 and the subsequent steps are performed if the variable n is larger than “2” in order to calculate a primary differential value at step S 06 . At step S 22 , the variable n is incremented by “1”, and the process proceeds to step S 03 .
  • a primary differential variable is calculated, and the array B(n) is set to calculated primary differential values.
  • a primary differential value is calculated by using the above equation (1) from the acceleration value A(n ⁇ 1) and the acceleration value A(n+1).
  • step S 07 it is determined whether the variable n is larger than “7”. If the variable n is larger than “7”, the process proceeds to step S 08 ; if not, the process proceeds to step S 22 . Step S 08 and the subsequent steps are performed if the variable n is larger than “7” in order to calculate a moving average at step S 08 . At step S 22 , the variable n is incremented by “1”, and the process returns to step S 03 .
  • a moving average of primary differential values is calculated, and the array S(n) is set to calculated moving averages. Specifically, a moving average is calculated by using the above equation (2) from the primary differential values B(n ⁇ 5), B(n ⁇ 4), B(n ⁇ 3), B(n ⁇ 2), B(n ⁇ 1) and B(n).
  • step S 09 it is determined whether the absolute value of a calculated moving average S(n) is equal to or smaller than the threshold value T 1 . If the absolute value of a moving average S(n) is equal to or smaller than the threshold T 1 , the process proceeds to step S 10 ; if not, the process proceeds to step S 12 .
  • step S 10 the stop counter C 1 is incremented by “1”, and the process proceeds to step S 11 .
  • step S 11 it is determined whether the stop counter C 1 is larger than the threshold value P. If the stop counter C 1 is larger than the threshold value P, the process ends; if not, the process proceeds to step S 12 .
  • the stop counter C 1 counts the number of times the absolute value of a moving average S(n) is equal to or smaller than the threshold value T 1 in a row. If the stop counter C 1 is larger than the threshold value P, the process ends; thus, the process ends when the absolute value of a moving average S(n) is equal to or smaller than the threshold value T 1 P times or more often in a row. If the absolute value of a moving average S(n) is equal to or smaller than the threshold value T 1 , it means that acceleration remains unchanged; if this state persists for a certain period of time, it means that no operation is being input to mobile phone 1 or the mobile phone is not held in a hand and lies on a desk, for example; thus, it is determined that mobile phone 1 is not being operated.
  • step S 12 it is determined whether the variable n is larger than “9”. If the variable n is larger than “9”, the process proceeds to step S 13 ; if not, the process proceeds to step S 22 . Step S 13 and the subsequent steps are performed if the variable n is larger than “9” in order to calculate a secondary differential value based on moving averages at step S 13 . At step S 22 , the variable n is incremented by “1”, and the process returns to step S 03 .
  • a differential value is calculated from moving averages S(n), and the array C(n) is set to calculated differential values. Specifically, a differential value is calculated by using the above equation (3) from the moving average S(n ⁇ 1) and the moving average S(n+1). In the present embodiment, a differential value that can be obtained by differentiating moving averages S(n) is denoted by a secondary differential value C(n).
  • step S 14 it is determined whether the secondary differential value C(n) is “0”. It should be noted that the C(n) may not be “0” for some sampling points, in which case, in order to determine whether the C(n) is “0”, it may be determined whether the C(n) is closest to “0”. If the secondary differential value C(n) is “0”, the process proceeds to step S 15 ; if not, the process proceeds to step S 22 . If the secondary differential value C(n) is “0”, the moving average S(n) is at a local maximum or a local minimum.
  • step S 15 the moving averages S(n) and S(n ⁇ 1) are compared with each other. If the moving average S(n) is larger than the moving average S(n ⁇ 1), the process proceeds to step S 16 ; if not, the process proceeds to step S 17 .
  • step S 16 the local maximum MAX, a variable to which the local maximum can be set, is set to the moving average S(n), and the process proceeds to step S 18 .
  • step S 17 the local maximum MIN, a variable to which the local maximum can be set, is set to the moving average S(n), and the process proceeds to step S 18 .
  • step S 18 the difference between the local maximum MAX and the local minimum MIN is calculated, and it is determined whether that difference is larger than the threshold value T 2 . If the difference is larger than the threshold value T 2 , the process proceeds to step S 19 ; if not, the process proceeds to step S 22 .
  • step S 19 the operation counter C 2 is incremented by “1”.
  • a character is determined based on an indicated position input from touch panel 5 and a value in the operation counter C 2 , and the process proceeds to step S 22 .
  • the variable n is incremented by “1”, and the process returns to step S 03 .
  • a key indicated by the user is identified based on key information including the pair of items: name and area for each of the keys contained in the image displayed on LCD 3 and on the indicated position input from touch panel 5 , and the identified key and the key table are used to determine the set of characters that have been allocated to the identified key; then, out of the set of characters, the character corresponding to the number of operations is determined.
  • the number of operations is the value in the operation counter C 2 .
  • a first vibration at sampling points 1 - 8 a second vibration at sampling points 8 - 21 and a third vibration at sampling points 22 - 33 are shown.
  • the first vibration is at its maximum at sampling point 4 , and at its minimum at sampling point 7 ;
  • the second vibration is at its maximum at sampling point 14 , and at its minimum at sampling point 20 ;
  • the third vibration is at its maximum at sampling point 27 , and at its minimum at sampling point 32 .
  • moving averages are shown with a first vibration at sampling points 7 - 10 , a second vibration at sampling points 11 - 22 and a third vibration at sampling points 23 - 35 .
  • the first vibration is at its maximum at sampling point 7 , and at its minimum at sampling point 9 .
  • the difference between the local maximum and the local minimum is smaller than the threshold value T 2 , such that an operation in which the user depresses touch panel 5 with a finger is not detected.
  • the second vibration is at its maximum at sampling point 13 , and at its minimum at sampling point 19 .
  • the difference between the local maximum and the local minimum is larger than the threshold value T 2 , such that an operation in which the user depresses touch panel 5 with a finger is detected.
  • the third vibration is at its maximum at sampling point 26 , and at its minimum at sampling point 32 .
  • the difference between the local maximum and the local minimum is larger than the threshold value T 2 , such that an operation in which the user depresses touch panel 5 with a finger is detected.
  • mobile phone 1 which serves as a portable device according to the present embodiment, detects an operation in which the user depresses touch panel 5 while continuously touching touch panel 5 based on an acceleration value detected while an indication on touch panel 5 is being detected, allowing the user to input an operation in which the user depresses one and the same position on the touch panel several times.
  • a specified operation is detected when the difference between a local maximum and a local minimum of differential values of acceleration values is equal to or larger than a predetermined threshold value, allowing detecting one operation based on one cycle of vibration generated by an operation in which the user depresses touch panel 5 with continuously touching touch panel 5 .
  • the detecting means calculates a moving average of differential values output from acceleration sensor 19 for a predetermined period of time and calculates the difference between a local maximum and a subsequent local minimum of moving averages, thereby reducing noise contained in the detected acceleration values. Particularly, it may reduce a signal different from a vibration generated by an operation in which the user depresses touch panel 5 while continuously touching touch panel 5 .
  • one character is determined out of a plurality of characters based on an indicated position detected by touch panel 5 and a number of times an operation in which the user depresses touch panel 5 while continuously touching touch panel 5 is detected, thereby allowing the user to select one character from a plurality of characters by just performing an operation(s) in which the user depresses one and the same position.
  • acceleration sensor 19 is disposed in such a way that it can detect an acceleration value in the direction perpendicular to the panel surface of touch panel 5 , thereby detecting a vibration generated by an operation in which the user depresses touch panel 5 while continuously touching touch panel 5 .
  • the present invention can, of course, be understood as including a method of detecting an operation for causing mobile phone 1 to perform the process for detecting an operation shown in FIG. 8 , or a program for detecting an operation for causing control unit 11 (i.e. a computer) included in mobile phone 1 to perform that method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Telephone Function (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
US13/126,075 2008-10-29 2009-10-26 Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation Abandoned US20110205177A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2008-278146 2008-10-29
JP2008278146A JP5280800B2 (ja) 2008-10-29 2008-10-29 携帯機器、操作検出方法および操作検出プログラム
PCT/JP2009/005638 WO2010050173A1 (ja) 2008-10-29 2009-10-26 携帯機器、操作検出方法および操作検出プログラムを記録したコンピュータ読み取り可能な記録媒体

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/005638 A-371-Of-International WO2010050173A1 (ja) 2008-10-29 2009-10-26 携帯機器、操作検出方法および操作検出プログラムを記録したコンピュータ読み取り可能な記録媒体

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/337,766 Continuation US9727216B2 (en) 2008-10-29 2014-07-22 Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation

Publications (1)

Publication Number Publication Date
US20110205177A1 true US20110205177A1 (en) 2011-08-25

Family

ID=42128543

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/126,075 Abandoned US20110205177A1 (en) 2008-10-29 2009-10-26 Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation
US14/337,766 Active 2029-12-06 US9727216B2 (en) 2008-10-29 2014-07-22 Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/337,766 Active 2029-12-06 US9727216B2 (en) 2008-10-29 2014-07-22 Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation

Country Status (4)

Country Link
US (2) US20110205177A1 (ja)
JP (1) JP5280800B2 (ja)
KR (1) KR101210740B1 (ja)
WO (1) WO2010050173A1 (ja)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100108756A1 (en) * 2008-10-30 2010-05-06 Oberthur Technologies Microcircuit card, electronic device associated with such a card, and method of controlling such an electronic device
CN103092480A (zh) * 2013-01-17 2013-05-08 广东欧珀移动通信有限公司 一种快速返回列表首页的方法及移动终端
US10427594B2 (en) * 2017-05-18 2019-10-01 J-MEX, Inc. Deceleration alert device and method
CN114237420A (zh) * 2020-05-06 2022-03-25 Oppo（重庆）智能科技有限公司 触摸屏控制方法及装置、电子设备、存储介质
EP4118518B1 (de) * 2021-05-26 2023-07-12 Mercedes-Benz Group AG Verfahren zur signalauswertung

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5742187B2 (ja) 2010-11-26 2015-07-01 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
KR101173400B1 (ko) 2010-12-02 2012-08-10 한국과학기술원 내장 가속도 센서를 이용한 휴대 기기에서의 터치스크린 조작 방법 및 휴대기기
JP5703873B2 (ja) 2011-03-17 2015-04-22 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
WO2013118522A1 (ja) * 2012-02-08 2013-08-15 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 携帯端末及びその動作方法
JP6497283B2 (ja) * 2015-09-11 2019-04-10 株式会社デンソー データ解析装置
JP2024024784A (ja) * 2022-08-10 2024-02-26 マレリ株式会社 操作パネル

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6369794B1 (en) * 1998-09-09 2002-04-09 Matsushita Electric Industrial Co., Ltd. Operation indication outputting device for giving operation indication according to type of user's action
US20060197753A1 (en) * 2005-03-04 2006-09-07 Hotelling Steven P Multi-functional hand-held device
US20060263068A1 (en) * 2005-05-19 2006-11-23 Sony Corporation Reproducing apparatus, program, and reproduction control method

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6201554B1 (en) * 1999-01-12 2001-03-13 Ericsson Inc. Device control apparatus for hand-held data processing device
US6466198B1 (en) * 1999-11-05 2002-10-15 Innoventions, Inc. View navigation and magnification of a hand-held device with a display
JP3910541B2 (ja) * 2003-01-21 2007-04-25 富士フイルム株式会社 画像格納装置
JP2005092441A (ja) * 2003-09-16 2005-04-07 Aizu:Kk 文字入力方法
JP5132028B2 (ja) * 2004-06-11 2013-01-30 三菱電機株式会社 ユーザインタフェース装置
JP2006178755A (ja) * 2004-12-22 2006-07-06 Hitachi Ltd 文字入力方法および文字入力装置
KR100879517B1 (ko) 2006-08-16 2009-01-22 삼성전자주식회사 휴대 단말기 및 그의 모드 전환 방법
JP2008234496A (ja) * 2007-03-22 2008-10-02 Mikio Uehara 入力装置
US20090153475A1 (en) * 2007-12-14 2009-06-18 Apple Inc. Use of a remote controller Z-direction input mechanism in a media system
WO2009105821A1 (en) * 2008-02-29 2009-09-03 Hamish Mclennan A method and system responsive to intentional movement of a device
US8587515B2 (en) * 2008-08-05 2013-11-19 Apple Inc. Systems and methods for processing motion sensor generated data
EP2341414A1 (en) * 2009-12-31 2011-07-06 Sony Computer Entertainment Europe Limited Portable electronic device and method of controlling a portable electronic device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6369794B1 (en) * 1998-09-09 2002-04-09 Matsushita Electric Industrial Co., Ltd. Operation indication outputting device for giving operation indication according to type of user's action
US20060197753A1 (en) * 2005-03-04 2006-09-07 Hotelling Steven P Multi-functional hand-held device
US20060263068A1 (en) * 2005-05-19 2006-11-23 Sony Corporation Reproducing apparatus, program, and reproduction control method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100108756A1 (en) * 2008-10-30 2010-05-06 Oberthur Technologies Microcircuit card, electronic device associated with such a card, and method of controlling such an electronic device
CN103092480A (zh) * 2013-01-17 2013-05-08 广东欧珀移动通信有限公司 一种快速返回列表首页的方法及移动终端
US10427594B2 (en) * 2017-05-18 2019-10-01 J-MEX, Inc. Deceleration alert device and method
CN114237420A (zh) * 2020-05-06 2022-03-25 Oppo（重庆）智能科技有限公司 触摸屏控制方法及装置、电子设备、存储介质
EP4118518B1 (de) * 2021-05-26 2023-07-12 Mercedes-Benz Group AG Verfahren zur signalauswertung

Also Published As

Publication number Publication date
WO2010050173A1 (ja) 2010-05-06
KR101210740B1 (ko) 2012-12-11
US20140337784A1 (en) 2014-11-13
US9727216B2 (en) 2017-08-08
KR20110077021A (ko) 2011-07-06
JP5280800B2 (ja) 2013-09-04
JP2010109552A (ja) 2010-05-13

Similar Documents

Publication Publication Date Title
US9727216B2 (en) Portable device, method of detecting operation, and computer-readable storage medium storing program for detecting operation
US20180121161A1 (en) Electronic device, control method, and storage medium
US9772661B2 (en) Electronic equipment with display device
US10764415B2 (en) Screen lighting method for dual-screen terminal and terminal
US9442655B2 (en) Character input device, and method and program for inputting character
US9189077B2 (en) User character input interface with modifier support
JP2013073330A (ja) 携帯型電子機器、タッチ領域設定方法およびプログラム
WO2016121876A1 (ja) 電子機器、制御方法、及び制御プログラム
KR20100062899A (ko) 터치 패턴을 이용한 입력 방법 및 장치
JP2012058910A (ja) 携帯端末装置及びプログラム
EP3731505A1 (en) Dialing method and mobile terminal
WO2018112803A1 (zh) 触摸屏手势识别的方法及装置
KR20070100209A (ko) 터치펜과 같은 보조도구가 필요 없는 터치스크린버튼입력방법
US20120038557A1 (en) Method and Electronic Device With Motion Compensation
US9014762B2 (en) Character input device, character input method, and character input program
JP4385864B2 (ja) 携帯端末及び情報入力方法
KR20090022465A (ko) 단말기 메뉴 선택 방법 및 이를 구비한 단말기
EP1569078B1 (en) Track wheel with reduced space requirements
KR20090040520A (ko) 휴대용 단말기에서 터치 스크린을 이용한 문자 입력 장치및 방법
JP5395599B2 (ja) 情報処理装置、入力装置及び情報処理装置の入力方法
JP2013201490A (ja) 携帯端末
JP2012226590A (ja) 携帯電子機器、制御方法及び制御プログラム
JP5542906B2 (ja) 文字入力装置、文字入力方法および文字入力プログラム
CN113608655A (zh) 信息处理方法、装置、电子设备和存储介质
KR100800724B1 (ko) 휴대단말기에서 데이터 입력 방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: KYOCERA CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NAKAI, YUTAKA;MATSUO, NAOKI;REEL/FRAME:026198/0182

Effective date: 20110422

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION