WO2006076411A2 - Recognition of scribed indicium on a user interface - Google Patents

Recognition of scribed indicium on a user interface Download PDF

Info

Publication number
WO2006076411A2
WO2006076411A2 PCT/US2006/000947 US2006000947W WO2006076411A2 WO 2006076411 A2 WO2006076411 A2 WO 2006076411A2 US 2006000947 W US2006000947 W US 2006000947W WO 2006076411 A2 WO2006076411 A2 WO 2006076411A2
Authority
WO
WIPO (PCT)
Prior art keywords
scribed
indicium
characters
scribing
scribing area
Prior art date
Application number
PCT/US2006/000947
Other languages
French (fr)
Other versions
WO2006076411A3 (en
Inventor
Hui Zhang
Original Assignee
Motorola Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc. filed Critical Motorola Inc.
Publication of WO2006076411A2 publication Critical patent/WO2006076411A2/en
Publication of WO2006076411A3 publication Critical patent/WO2006076411A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/142Image acquisition using hand-held instruments; Constructional details of the instruments
    • G06V30/1423Image acquisition using hand-held instruments; Constructional details of the instruments the instrument generating sequences of position coordinates corresponding to handwriting

Definitions

  • the invention relates generally to performing recognition of a scribed indicium on a user interface.
  • the invention is particularly useful for, but not necessarily limited to, performing automatic recognition of indicia of different sets of characters scribed on a touch screen of an electronic device.
  • Electronic devices increasingly include a user interface in the form of a touch screen, particularly small electronic devices such as mobile telephones and personal digital assistants (PDA).
  • touch screens enable a user to input information by virtue of, for example, virtual buttons or character recognition.
  • character recognition a character is hand scribed in a scribing area of the touch screen and character recognition software determines one or more candidate characters corresponding to the hand scribed character.
  • Such techniques are particularly useful for inputting complex ideographic characters that appear in languages such as Chinese, Japanese and Korean.
  • character recognition software has been provided in which a user can select a mode of operation, such as alphanumeric character recognition mode, punctuation recognition mode or ideographic character recognition mode.
  • a mode of operation such as alphanumeric character recognition mode, punctuation recognition mode or ideographic character recognition mode.
  • this can be inconvenient for the user because it can necessitate the user repeatedly switching between modes even when inputting relatively short sentences. For example, the relatively
  • the invention is a method for performing recognition of a scribed indicium on a user interface of an electronic device, the method comprising: receiving a scribed indicium scribed on the user interface, the user interface at least comprising a first scribing area and a second scribing area, the first scribing area being designated to recognise the indicium scribed therein as a candidate character from a first set of characters, the second scribing area being designated to recognise the indicium scribed therein as a candidate character from a second set of characters; and performing large screen indicium character recognition on the scribed indicium when the scribed indicium extends into more than one of the scribing areas, the performing being determined by recognising the scribed indicium as a candidate character from a third set of characters.
  • the performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area and the second scribing area.
  • the performing large screen indicium character recognition may occur when at least 25% of the scribed indicium is scribed in the first scribing area and the second scribing area.
  • the method may further include performing small indicium character recognition when the scribed indicium is scribed only in the first scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters and when the scribed indicium is scribed only in the second scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the second set of characters.
  • the method may further include performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least 90% of the scribed indicium is scribed in the first scribing area and by recognising the scribed indicium as a candidate character from the second set of characters when at least 90% of the scribed indicium is scribed in the second scribing area.
  • the method may further include performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least
  • the user interface may further comprise a third scribing area, the third scribing area being designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters.
  • the performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area and the third scribing area.
  • the first set of characters are punctuation
  • the second set of characters are letters
  • the third set of characters are ideographic characters
  • the fourth set of characters are digits.
  • the user interface may further comprise a fourth scribing area, the fourth scribing area being designated to recognise the indicium scribed therein as a candidate character from a fifth set of characters.
  • the performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
  • the performing large screen indicium character recognition may occur when at least 75% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
  • the first set of characters are punctuation
  • the second set of characters are lower case letters
  • the third set of characters are ideographic characters
  • the fourth set of characters are digits
  • the fifth set of characters are upper case letters.
  • the method may further include displaying in at least one of the scribing areas at least one character from the set of characters which the at least one scribing area is designated to recognise.
  • FIG. 1 is a schematic diagram illustrating an embodiment of an electronic device according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram illustrating a first embodiment of a user interface of the electronic device of FIG. 1;
  • FIG. 3 is a flow diagram illustrating a method for performing recognition of a scribed indicium on the user interface of FIG. 2;
  • FIG. 4 is a schematic diagram illustrating a second embodiment of the user interface to further illustrate the method of FIG 3;
  • FIG. 5 is a schematic diagram illustrating a third embodiment of the user interface to further illustrate the method of FIG 3.
  • FIG. 1 there is a schematic diagram illustrating an electronic device 100 in the form of a mobile station or mobile telephone comprising a radio frequency communications unit 102 coupled to be in communication with a processor 103.
  • the mobile telephone 100 also has a user interface in the form of a touch screen 105 coupled to be in communication with the processor 103.
  • a keypad 106 coupled to be in communication with the processor 103, may also be provided.
  • the processor 103 includes an encoder/decoder 111 with an associated code Read Only Memory (ROM) 112 for storing data for encoding and decoding voice or other signals that may be transmitted or received by the mobile telephone 100.
  • the processor 103 also includes a micro-processor 113 coupled, by a common data and address bus 117, to the encoder/decoder 111, a character Read Only Memory (ROM) 114, a Random Access Memory (RAM) 104, static programmable memory 116 and a Removable User Identity Module (RUIM) interface 118.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • RUIM Removable User Identity Module
  • the static programmable memory 116 and a RUIM card 119 (commonly referred to as a Subscriber Identity Module (SIM) card) operatively coupled to the RUIM interface 118 each can store, amongst other things, Preferred Roaming Lists (PRLs), subscriber authentication data, selected incoming text messages and a Telephone Number Database (TND phonebook) comprising a number field for telephone numbers and a name field for identifiers associated with one of the numbers in the name field. For instance, one entry in the Telephone Number Database may be 91999111111 (entered in the number field) with an associated identifier "Steven C! at work" in the name field.
  • the RUIM card 119 and static memory 116 may also store passwords for allowing accessibility to password-protected functions on the mobile telephone 100.
  • the micro-processor 113 has ports for coupling to the keypad 106, touch screen 105 and an alert 115 that typically contains an alert speaker, vibrator motor and associated drivers. Also, micro-processor 113 has ports for coupling to a microphone 135 and communications speaker 140.
  • Read Only Memory 114 stores code for decoding or encoding text messages that may be received by the communications unit 102. hi this embodiment the character Read Only Memory 114, RUIM card 119, and static memory 116 may also store Operating Code (OC) for the micro-processor 113 and code for performing functions associated with the mobile telephone 100.
  • OC Operating Code
  • the radio frequency communications unit 102 is a combined receiver and transmitter having a common antenna 107.
  • the communications unit 102 has a transceiver 108 coupled to the antenna 107 via a radio frequency amplifier 109.
  • the transceiver 108 is also coupled to a combined modulator/demodulator 110 that couples the communications unit 102 to the processor 103.
  • the electronic device 100 can be any electronic device including a radio telephone, a conventional type telephone, a laptop computer, a tablet personal computer (PC) or a PDA.
  • a user can select an application by traversing menus or selecting icons displayed on the touch screen 105.
  • the touch screen 105 can be integral with or an accessory to the electronic device 100.
  • the touch screen 105 has an incorporated driver that is controllable by micro-processor 113.
  • the touch screen 105 is a two-way user interface for typically allowing data entry, invoking device applications and commands, menu traversing, displaying text, displaying graphics and displaying menus. Data entry and other user input requirements to the touch screen 105 is typically by use of a stylus and may involve scribing characters onto the touch screen 105 as will be apparent to a person skilled in the art.
  • the user interface in this embodiment is in the form of a touch screen 105
  • the user interface can be any means of inputting scribed indicia to the electronic device, such as a tablet or electronic touch sensitive pad and the like.
  • the touch screen 105 comprises a display surface
  • the first and second scribing areas 201, 202 are defined partly by a boundary 203 between the first and second scribing areas, although the boundary 203 need not be displayed on the display surface 200. Whilst FIG. 2 shows display surface 200 divided horizontally by boundary 203, it will be appreciated by a person skilled in the art that display surface 200 may be divided in some other manner, such as vertically or diagonally, to create first scribing area 201 and second scribing area 202.
  • the first scribing area 201 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters.
  • the designation of the characters from the first set of characters is identified by displaying a "watermark" or indicator 208 in the first scribing area 201, the indicator 208 displaying at least one character from the first set of characters.
  • indicator 208 displays "Abcl23" thereby advising a user that the first scribing area 201 is designated to perform character recognition on upper case characters, lower case characters and digits 0 to 9.
  • the second scribing area 202 is designated to recognise the indicium scribed therein as a candidate character from a second set of characters.
  • indicator 209 displays ";!?"" thereby advising a user that the second scribing area 202 is designated to perform character recognition on punctuation.
  • the indicators 208, 209 are marked on a housing of the electronic device 100 adjacent the first and second scribing areas 201, 202 respectively.
  • the indicators 208, 209 may be activated and deactivated at the user's discretion.
  • the indicators 208, 209 are omitted.
  • the indicium 204 may be scribed in both the first scribing area 201 and the second scribing area 202, typically resulting in a larger indicium than indicia that are scribed only in the first or second scribing areas 201, 202.
  • FIG. 3 there is illustrated in accordance with an embodiment of the invention a method 300 for performing recognition of a scribed indicium on the user interface in the form of the touch screen 105 of the electronic device 100.
  • the method 300 is primarily performed by processor 103 and comprises a start operation 301 typically invoked by an interrupt when a user selects a handwriting input mode.
  • the method 300 comprises an operation of receiving 302 a scribed indicium 204 scribed on the touch screen 105.
  • a test 303 is then conducted to determine if the scribed indicium 204 extends into more than one scribing area, i.e., into both the first scribing area 201 and the second scribing area 202. If test 303 is satisfied, the method 300 includes performing 304 large screen indicium character recognition on the scribed indicium 304. Performing 304 large screen indicium character recognition is determined by recognising the scribed indicium 204 as a candidate character from a third set of characters.
  • test 303 is not satisfied, which, according to one embodiment, is when the scribed indicium is scribed only in the first scribing area 201 or only in the second scribing area 202
  • the method 300 includes performing 305 small indicium character recognition on the scribed indicium 204. Performing 305 small indicium character recognition is determined by recognising the scribed indicium as a candidate character from the first set of characters when the indicium is scribed only in the first scribing area 201 and recognising the scribed indicium as a candidate character from the second set of characters when the indicium is scribed only in the second scribing area 202.
  • test 303 includes determining whether a threshold value of at least 10% of the indicium 204 is scribed in both the first and second scribing areas 201, 202. If test 303 is satisfied, the method includes performing 304 large screen indicium character recognition on the scribed indicium 204. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition on the scribed indicium 204. In another embodiment, the threshold value is at least 25%.
  • test 303 includes determining whether a threshold value of at least 90% of the indicium 204 is scribed in the first or second scribing area 201, 202. When at least 90% of the indicium is scribed in the first or second scribing area 201, 202, even if the indicium has been carelessly scribed, it is likely that the user intended the indicium to be scribed in the area in which the majority of the indicium is scribed.
  • the indicium is determined not to extend into both areas 201, 202 and the method includes performing 305 small indicium character recognition by recognising the scribed indicium 204 as a candidate character from the first or second set of characters.
  • the scribed indicium 204 is determined to extend into both areas and the method includes performing 304 large screen indicium character recognition, hi an alternative embodiment, the threshold value is at least 75% to determine whether the scribed indicium 204 is scribed in the first scribing area 201 or the second scribing area 202 or both first and second scribing areas 201, 202.
  • the method includes displaying 306 one or more candidate characters in a display area 205 of the touch screen 105.
  • a user can then determine 307 whether the desired character has been displayed. If so, the method includes the user selecting 308 the desired character by touching the appropriate character in the display area 205.
  • the selected candidate character is then inserted into a character string, such as a text message, in a message display area 206 of the touch screen 105 and the method 300 ends at end operation 309. If the desired character has not been displayed in the display area 205, perhaps due to careless scribing of the indicium such that correct character recognition has not occurred, the method includes refreshing 310 the display 200 to prepare the display 200 for receiving 302 a new indicium.
  • the first set of characters are punctuation, such as ",”, “!, “?”, ".”, “;” , “:”
  • the second set of characters are alphanumeric characters, such as letters of the alphabet and digits
  • the third set of characters are ideographic characters, such as characters forming the Chinese alphabet. It will be appreciated by a person skilled in the art that in alternative embodiments, the set of characters that the first and second scribing areas 201, 202 are designated to recognise and the third set of characters may be different to those specified above. Referring to FIG.
  • the user interface in the form of the touch screen 105 comprises a first scribing area 401, a second scribing area 402 and a third scribing area 403.
  • the first, second and third scribing areas 401, 402, 403 are defined partly by a boundary 404 between the first and second scribing areas 401, 402 and partly by a boundary 405 between second and third scribing areas 402, 403, although boundaries 404 and 405 need not be displayed on the display surface 200.
  • the first scribing area 401 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters.
  • the second scribing area 402 is designated to recognise an indicium 204 scribed therein as a candidate character from a second set of characters.
  • the third scribing area 403 is designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters.
  • an indicium 204 extending into two or more of the scribing areas 401, 402, 403 is recognised as a candidate character from a third set of characters.
  • an indicium 204 extending into both the first and second scribing areas 401, 402 or in both the second and third scribing areas 402, 403 or in the first, second and third scribing areas 401, 402, 403 is recognised as a candidate character from a third set of characters.
  • the set of characters from which the scribed indicium is recognised as a candidate character depends on the scribing areas into which the scribed indicium 204 extends. For example, where the scribed indicium 204 extends into the first and second scribing areas 401, 402, one set of characters is considered. Where the scribed indicium 204 extends into the second and third scribing areas 402, 403, another set of characters is considered.
  • the first set of characters are punctuation
  • the second set of characters are letters
  • the third set of characters are ideographic characters
  • the fourth set of characters are digits, as advised to a user by indicators 406, 407 and 408 respectively.
  • the indicators 406, 407 and 408 are marked on a housing of the electronic device 100 adjacent the first, second and third scribing areas 401, 402, 403 respectively.
  • the indicators 406, 407 and 408 may be activated and deactivated at the user's discretion.
  • the indicators 406, 407 and 408 may be activated and deactivated at the user's discretion.
  • the indicators 406, 407 and 408 may be activated and deactivated at the user's discretion.
  • test 303 to determine whether the scribed indicium 204 extends into more than one scribing area includes determining if the threshold value of at least 10% of the scribed indicium 204 is scribed in the first scribing area 401 , the second scribing area 402 and the third scribing area 403. If test 303 is satisfied, the method 300 includes performing 304 large screen indicium character recognition by recognising the scribed indicium 204 as a candidate character from the third set of characters. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition. In another embodiment, the threshold value is at least 25%.
  • the user interface in the form of the touch screen 105 comprises a first scribing area 501, a second scribing area 502, a third scribing area 503 and a fourth scribing area 504.
  • the first, second, third and fourth scribing areas 501, 502, 503 and 504 are defined partly by boundaries 505 and 506, although boundaries 505 and 506 need not be displayed on the display surface 200.
  • the first scribing area 501 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters.
  • the second scribing area 502 is designated to recognise an indicium 204 scribed therein as a candidate character from a second set of characters.
  • the third scribing area 503 is designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters.
  • the fourth scribing area 504 is designated to recognise the indicium scribed therein as a candidate character from a fifth set of characters.
  • an indicium 204 extending into two or more scribing areas is recognised as a candidate character from a third set of characters.
  • an indicium 204 scribed in any two, any three or all four of the first, second, third and fourth scribing areas 501, 502, 503, 504 is recognised as a candidate character from a third set of characters.
  • the set of characters from which the scribed indicium is recognised as a candidate character depends on the scribing areas into which the scribed indicium 204 extends. For example, where the scribed indicium 204 extends into the first, second and third scribing areas 501, 502,
  • the scribed indicium 204 extends into the second, third and fourth scribing areas 502, 503, 504 another set of characters is considered.
  • the first set of characters are punctuation
  • the second set of characters are lower case letters
  • the third set of characters are ideographic characters
  • the fourth set of characters are digits
  • the fifth set of characters are upper case letters.
  • the designations of the first, second, third and fourth scribing areas 501, 502, 503 and 504 are advised to a user by indicators 507, 508, 509 and 510 respectively.
  • the indicators 507, 508, 509 and 510 are marked on a housing of the electronic device 100 adjacent the first, second, third and fourth scribing areas 501, 502, 503 and 504 respectively.
  • the indicators 507, 508, 509 and 510 may be activated and deactivated at the user's discretion.
  • the indicators 507, 508, 509 and 510 are omitted.
  • test 303 to determine whether the scribed indicium 204 extends into more than one scribing area includes determining if the threshold value of at least 10% of the scribed indicium 204 is scribed in the first, second, third and fourth scribing areas 501, 502, 503, 504. If test 303 is satisfied, the method includes performing 304 large screen indicium character recognition by recognising the scribed indicium 204 as a candidate character from the third set of characters. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition.
  • test 303 employs a threshold value of at least 75%, such that the method includes performing 304 large screen indicium character recognition when at least 75% of the scribed indicium 204 is scribed in the first scribing area 501, second scribing area 502, third scribing area 503 and fourth scribing area 504.
  • the touch screen 105 also comprises predictive display area 210.
  • predictive display area 210 displays one or more candidate characters that may follow the one or more candidate characters displayed in display area 205 to form a word, or part thereof, or to form a sound, in a particular language.
  • Recognition of the scribed indicium may include normalizing the scribed indicium 204 to provide a scaled indicium, which is compared with sets of templates for each set of characters.
  • Recognition of the scribed indicium 204 may also include conversion of any curved indicium or parts thereof into straight lines. Both normalizing and conversion of the scribed indicium are well known to persons skilled in the art.
  • the present invention is therefore a method for performing automatic recognition of indicia of different sets of characters scribed on a touch screen of an electronic device in a single mode of operation without the need for a user to switch modes to scribe the indicia of different sets of characters.
  • the user can therefore scribe upper and lower case letters, numbers, punctuation and ideographic characters whilst remaining in the same mode of the electronic device. Character recognition accuracy and speed are not degraded however, because of the provision of scribing areas designated to recognise indicia scribed therein as candidate characters from specific sets of characters. Furthermore, the problem of insufficient space to accommodate virtual buttons for all the different characters is obviated.

Abstract

A method (300) for performing recognition of a scribed indicium (204) on a user interface in the form of a touch screen (105) of an electronic device (100), the method comprising receiving (302) a scribed indicium scribed on the user interface, the user interface at least comprising a first scribing area (201) and a second scribing area (202). The first scribing area (201) is designated to recognise the indicium scribed therein as a candidate character from a first set of characters and the second scribing area (202) is designated to recognise the indicium scribed therein as a candidate character from a second set of characters. The method includes performing (304) large screen indicium character recognition on the scribed indicium when the scribed indicium extends into more than one of the scribing areas (201, 202). The performing (304) is determined by recognising the scribed indicium as a candidate character from a third set of characters.

Description

RECOGNITION OF SCRIBED INDICIUM ON A USER INTERFACE
FIELD OF THE INVENTION
The invention relates generally to performing recognition of a scribed indicium on a user interface. The invention is particularly useful for, but not necessarily limited to, performing automatic recognition of indicia of different sets of characters scribed on a touch screen of an electronic device.
BACKGROUND OF THE INVENTION
Electronic devices increasingly include a user interface in the form of a touch screen, particularly small electronic devices such as mobile telephones and personal digital assistants (PDA). In addition to displaying information, touch screens enable a user to input information by virtue of, for example, virtual buttons or character recognition. In the case of character recognition, a character is hand scribed in a scribing area of the touch screen and character recognition software determines one or more candidate characters corresponding to the hand scribed character. Such techniques are particularly useful for inputting complex ideographic characters that appear in languages such as Chinese, Japanese and Korean.
When hand scribing a sentence on a touch screen a user often needs to input characters other than alphanumeric characters. Such characters may be punctuation and/or the aforementioned ideographic characters. However, because the touch screen is often relatively small, especially for mobile telephones and PDAs, there is often insufficient space on the touch screen to allocate a dedicated virtual button for all the major commonly used non- alphanumeric characters.
One attempt to overcome this problem is the provision of character recognition software that can recognize punctuation and ideographic characters as well as alphanumeric characters in a common recognition mode. However, such common recognition software may reduce character recognition accuracy and can reduce character recognition speed.
To improve the accuracy and speed, character recognition software has been provided in which a user can select a mode of operation, such as alphanumeric character recognition mode, punctuation recognition mode or ideographic character recognition mode. However, this can be inconvenient for the user because it can necessitate the user repeatedly switching between modes even when inputting relatively short sentences. For example, the relatively
short sentence " ~F^F2 : 00^ John' s Λ1I.RL, OK? " may require the user to
change modes as many as thirteen times.
In this specification, including the claims, the terms "comprises", "comprising" or similar terms are intended to mean a non-exclusive inclusion, such that a method or apparatus that comprises a list of elements does not include those elements solely, but may well include other elements not listed. SUMMARY OF THE INVENTION
Accordingly, in one form the invention is a method for performing recognition of a scribed indicium on a user interface of an electronic device, the method comprising: receiving a scribed indicium scribed on the user interface, the user interface at least comprising a first scribing area and a second scribing area, the first scribing area being designated to recognise the indicium scribed therein as a candidate character from a first set of characters, the second scribing area being designated to recognise the indicium scribed therein as a candidate character from a second set of characters; and performing large screen indicium character recognition on the scribed indicium when the scribed indicium extends into more than one of the scribing areas, the performing being determined by recognising the scribed indicium as a candidate character from a third set of characters.
The performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area and the second scribing area.
The performing large screen indicium character recognition may occur when at least 25% of the scribed indicium is scribed in the first scribing area and the second scribing area.
The method may further include performing small indicium character recognition when the scribed indicium is scribed only in the first scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters and when the scribed indicium is scribed only in the second scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the second set of characters.
The method may further include performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least 90% of the scribed indicium is scribed in the first scribing area and by recognising the scribed indicium as a candidate character from the second set of characters when at least 90% of the scribed indicium is scribed in the second scribing area.
The method may further include performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least
75% of the scribed indicium is scribed in the first scribing area and by recognising the scribed indicium as a candidate character from the second set of characters when at least 75% of the scribed indicium is scribed in the second scribing area. Suitably, the first set of characters are punctuation, the second set of characters are alphanumeric characters and the third set of characters are ideographic characters. The user interface may further comprise a third scribing area, the third scribing area being designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters.
The performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area and the third scribing area.
Suitably, the first set of characters are punctuation, the second set of characters are letters, the third set of characters are ideographic characters and the fourth set of characters are digits. The user interface may further comprise a fourth scribing area, the fourth scribing area being designated to recognise the indicium scribed therein as a candidate character from a fifth set of characters.
The performing large screen indicium character recognition may occur when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
The performing large screen indicium character recognition may occur when at least 75% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
Suitably, the first set of characters are punctuation, the second set of characters are lower case letters, the third set of characters are ideographic characters, the fourth set of characters are digits and the fifth set of characters are upper case letters. The method may further include displaying in at least one of the scribing areas at least one character from the set of characters which the at least one scribing area is designated to recognise.
BRIEF DESCRIPTION OF THE DRAWINGS
In order that the invention may be readily understood and put into practical effect, reference will now be made to exemplary embodiments as illustrated with reference to the accompanying drawings, wherein like reference numbers refer to like elements, in which:
FIG. 1 is a schematic diagram illustrating an embodiment of an electronic device according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating a first embodiment of a user interface of the electronic device of FIG. 1;
FIG. 3 is a flow diagram illustrating a method for performing recognition of a scribed indicium on the user interface of FIG. 2;
FIG. 4 is a schematic diagram illustrating a second embodiment of the user interface to further illustrate the method of FIG 3; and
FIG. 5 is a schematic diagram illustrating a third embodiment of the user interface to further illustrate the method of FIG 3. DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
Referring to FIG. 1, there is a schematic diagram illustrating an electronic device 100 in the form of a mobile station or mobile telephone comprising a radio frequency communications unit 102 coupled to be in communication with a processor 103. The mobile telephone 100 also has a user interface in the form of a touch screen 105 coupled to be in communication with the processor 103. As will be apparent to a person skilled in the art, a keypad 106, coupled to be in communication with the processor 103, may also be provided.
The processor 103 includes an encoder/decoder 111 with an associated code Read Only Memory (ROM) 112 for storing data for encoding and decoding voice or other signals that may be transmitted or received by the mobile telephone 100. The processor 103 also includes a micro-processor 113 coupled, by a common data and address bus 117, to the encoder/decoder 111, a character Read Only Memory (ROM) 114, a Random Access Memory (RAM) 104, static programmable memory 116 and a Removable User Identity Module (RUIM) interface 118. The static programmable memory 116 and a RUIM card 119 (commonly referred to as a Subscriber Identity Module (SIM) card) operatively coupled to the RUIM interface 118 each can store, amongst other things, Preferred Roaming Lists (PRLs), subscriber authentication data, selected incoming text messages and a Telephone Number Database (TND phonebook) comprising a number field for telephone numbers and a name field for identifiers associated with one of the numbers in the name field. For instance, one entry in the Telephone Number Database may be 91999111111 (entered in the number field) with an associated identifier "Steven C! at work" in the name field. The RUIM card 119 and static memory 116 may also store passwords for allowing accessibility to password-protected functions on the mobile telephone 100.
The micro-processor 113 has ports for coupling to the keypad 106, touch screen 105 and an alert 115 that typically contains an alert speaker, vibrator motor and associated drivers. Also, micro-processor 113 has ports for coupling to a microphone 135 and communications speaker 140. The character
Read Only Memory 114 stores code for decoding or encoding text messages that may be received by the communications unit 102. hi this embodiment the character Read Only Memory 114, RUIM card 119, and static memory 116 may also store Operating Code (OC) for the micro-processor 113 and code for performing functions associated with the mobile telephone 100.
The radio frequency communications unit 102 is a combined receiver and transmitter having a common antenna 107. The communications unit 102 has a transceiver 108 coupled to the antenna 107 via a radio frequency amplifier 109. The transceiver 108 is also coupled to a combined modulator/demodulator 110 that couples the communications unit 102 to the processor 103.
The electronic device 100 can be any electronic device including a radio telephone, a conventional type telephone, a laptop computer, a tablet personal computer (PC) or a PDA. A user can select an application by traversing menus or selecting icons displayed on the touch screen 105.
The touch screen 105 can be integral with or an accessory to the electronic device 100. The touch screen 105 has an incorporated driver that is controllable by micro-processor 113. The touch screen 105 is a two-way user interface for typically allowing data entry, invoking device applications and commands, menu traversing, displaying text, displaying graphics and displaying menus. Data entry and other user input requirements to the touch screen 105 is typically by use of a stylus and may involve scribing characters onto the touch screen 105 as will be apparent to a person skilled in the art.
Furthermore, although the user interface in this embodiment is in the form of a touch screen 105, the user interface can be any means of inputting scribed indicia to the electronic device, such as a tablet or electronic touch sensitive pad and the like.
Referring to FIG. 2, the touch screen 105 comprises a display surface
200 at least comprising a first scribing area 201 and a second scribing area 202. The first and second scribing areas 201, 202 are defined partly by a boundary 203 between the first and second scribing areas, although the boundary 203 need not be displayed on the display surface 200. Whilst FIG. 2 shows display surface 200 divided horizontally by boundary 203, it will be appreciated by a person skilled in the art that display surface 200 may be divided in some other manner, such as vertically or diagonally, to create first scribing area 201 and second scribing area 202. The first scribing area 201 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters. In one embodiment, the designation of the characters from the first set of characters is identified by displaying a "watermark" or indicator 208 in the first scribing area 201, the indicator 208 displaying at least one character from the first set of characters. As illustrated, in this embodiment, indicator 208 displays "Abcl23" thereby advising a user that the first scribing area 201 is designated to perform character recognition on upper case characters, lower case characters and digits 0 to 9. The second scribing area 202 is designated to recognise the indicium scribed therein as a candidate character from a second set of characters. As illustrated, in this embodiment, indicator 209 displays ";!?"" thereby advising a user that the second scribing area 202 is designated to perform character recognition on punctuation. In an alternative embodiment, the indicators 208, 209 are marked on a housing of the electronic device 100 adjacent the first and second scribing areas 201, 202 respectively. In another embodiment, the indicators 208, 209 may be activated and deactivated at the user's discretion. In a further embodiment, the indicators 208, 209 are omitted. As illustrated, the indicium 204 may be scribed in both the first scribing area 201 and the second scribing area 202, typically resulting in a larger indicium than indicia that are scribed only in the first or second scribing areas 201, 202. Referring to FIG. 3, there is illustrated in accordance with an embodiment of the invention a method 300 for performing recognition of a scribed indicium on the user interface in the form of the touch screen 105 of the electronic device 100. The method 300 is primarily performed by processor 103 and comprises a start operation 301 typically invoked by an interrupt when a user selects a handwriting input mode.
The method 300 comprises an operation of receiving 302 a scribed indicium 204 scribed on the touch screen 105. A test 303 is then conducted to determine if the scribed indicium 204 extends into more than one scribing area, i.e., into both the first scribing area 201 and the second scribing area 202. If test 303 is satisfied, the method 300 includes performing 304 large screen indicium character recognition on the scribed indicium 304. Performing 304 large screen indicium character recognition is determined by recognising the scribed indicium 204 as a candidate character from a third set of characters. If test 303 is not satisfied, which, according to one embodiment, is when the scribed indicium is scribed only in the first scribing area 201 or only in the second scribing area 202, the method 300 includes performing 305 small indicium character recognition on the scribed indicium 204. Performing 305 small indicium character recognition is determined by recognising the scribed indicium as a candidate character from the first set of characters when the indicium is scribed only in the first scribing area 201 and recognising the scribed indicium as a candidate character from the second set of characters when the indicium is scribed only in the second scribing area 202. In practice, a user may intend to scribe the indicium 204 only in the first scribing area 201 or only in the second scribing area 202, but carelessly scribe the indicium such that it extends into both the first and second scribing areas 201, 202. Therefore, in one embodiment, test 303 includes determining whether a threshold value of at least 10% of the indicium 204 is scribed in both the first and second scribing areas 201, 202. If test 303 is satisfied, the method includes performing 304 large screen indicium character recognition on the scribed indicium 204. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition on the scribed indicium 204. In another embodiment, the threshold value is at least 25%.
In another embodiment, test 303 includes determining whether a threshold value of at least 90% of the indicium 204 is scribed in the first or second scribing area 201, 202. When at least 90% of the indicium is scribed in the first or second scribing area 201, 202, even if the indicium has been carelessly scribed, it is likely that the user intended the indicium to be scribed in the area in which the majority of the indicium is scribed. If at least 90% of the indicium is scribed in the first or second scribing area 201, 202, the indicium is determined not to extend into both areas 201, 202 and the method includes performing 305 small indicium character recognition by recognising the scribed indicium 204 as a candidate character from the first or second set of characters. If at least 90% of the indicium is not scribed in the first or second scribing area 201, 202, the scribed indicium 204 is determined to extend into both areas and the method includes performing 304 large screen indicium character recognition, hi an alternative embodiment, the threshold value is at least 75% to determine whether the scribed indicium 204 is scribed in the first scribing area 201 or the second scribing area 202 or both first and second scribing areas 201, 202.
Once the scribed indicium 204 has been recognised, the method includes displaying 306 one or more candidate characters in a display area 205 of the touch screen 105. A user can then determine 307 whether the desired character has been displayed. If so, the method includes the user selecting 308 the desired character by touching the appropriate character in the display area 205. The selected candidate character is then inserted into a character string, such as a text message, in a message display area 206 of the touch screen 105 and the method 300 ends at end operation 309. If the desired character has not been displayed in the display area 205, perhaps due to careless scribing of the indicium such that correct character recognition has not occurred, the method includes refreshing 310 the display 200 to prepare the display 200 for receiving 302 a new indicium.
In one embodiment, the first set of characters are punctuation, such as ",", "!", "?", ".", ";" , ":", the second set of characters are alphanumeric characters, such as letters of the alphabet and digits and the third set of characters are ideographic characters, such as characters forming the Chinese alphabet. It will be appreciated by a person skilled in the art that in alternative embodiments, the set of characters that the first and second scribing areas 201, 202 are designated to recognise and the third set of characters may be different to those specified above. Referring to FIG. 4, in a second embodiment, the user interface in the form of the touch screen 105 comprises a first scribing area 401, a second scribing area 402 and a third scribing area 403. The first, second and third scribing areas 401, 402, 403 are defined partly by a boundary 404 between the first and second scribing areas 401, 402 and partly by a boundary 405 between second and third scribing areas 402, 403, although boundaries 404 and 405 need not be displayed on the display surface 200.
The first scribing area 401 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters. The second scribing area 402 is designated to recognise an indicium 204 scribed therein as a candidate character from a second set of characters. The third scribing area 403 is designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters. In one embodiment, an indicium 204 extending into two or more of the scribing areas 401, 402, 403 is recognised as a candidate character from a third set of characters. For example, an indicium 204 extending into both the first and second scribing areas 401, 402 or in both the second and third scribing areas 402, 403 or in the first, second and third scribing areas 401, 402, 403 is recognised as a candidate character from a third set of characters. In another embodiment, where the scribed indicium 204 extends into more than one scribing area, the set of characters from which the scribed indicium is recognised as a candidate character depends on the scribing areas into which the scribed indicium 204 extends. For example, where the scribed indicium 204 extends into the first and second scribing areas 401, 402, one set of characters is considered. Where the scribed indicium 204 extends into the second and third scribing areas 402, 403, another set of characters is considered.
In one embodiment, the first set of characters are punctuation, the second set of characters are letters, the third set of characters are ideographic characters and the fourth set of characters are digits, as advised to a user by indicators 406, 407 and 408 respectively. In alternative embodiments, the indicators 406, 407 and 408 are marked on a housing of the electronic device 100 adjacent the first, second and third scribing areas 401, 402, 403 respectively. Alternatively, the indicators 406, 407 and 408 may be activated and deactivated at the user's discretion. In a further embodiment, the indicators
406, 407 and 408 are omitted.
With the user interface shown in FIG. 4, in one embodiment, test 303 to determine whether the scribed indicium 204 extends into more than one scribing area includes determining if the threshold value of at least 10% of the scribed indicium 204 is scribed in the first scribing area 401 , the second scribing area 402 and the third scribing area 403. If test 303 is satisfied, the method 300 includes performing 304 large screen indicium character recognition by recognising the scribed indicium 204 as a candidate character from the third set of characters. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition. In another embodiment, the threshold value is at least 25%.
Referring to FIG. 5, in a third embodiment, the user interface in the form of the touch screen 105 comprises a first scribing area 501, a second scribing area 502, a third scribing area 503 and a fourth scribing area 504. The first, second, third and fourth scribing areas 501, 502, 503 and 504 are defined partly by boundaries 505 and 506, although boundaries 505 and 506 need not be displayed on the display surface 200.
The first scribing area 501 is designated to recognise an indicium 204 scribed therein as a candidate character from a first set of characters. The second scribing area 502 is designated to recognise an indicium 204 scribed therein as a candidate character from a second set of characters. The third scribing area 503 is designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters. The fourth scribing area 504 is designated to recognise the indicium scribed therein as a candidate character from a fifth set of characters. In one embodiment, an indicium 204 extending into two or more scribing areas is recognised as a candidate character from a third set of characters. For example, an indicium 204 scribed in any two, any three or all four of the first, second, third and fourth scribing areas 501, 502, 503, 504 is recognised as a candidate character from a third set of characters. In another embodiment, where the scribed indicium 204 extends into more than one scribing area, the set of characters from which the scribed indicium is recognised as a candidate character depends on the scribing areas into which the scribed indicium 204 extends. For example, where the scribed indicium 204 extends into the first, second and third scribing areas 501, 502,
503 one set of characters is considered. Where the scribed indicium 204 extends into the second, third and fourth scribing areas 502, 503, 504 another set of characters is considered. In one embodiment, the first set of characters are punctuation, the second set of characters are lower case letters, the third set of characters are ideographic characters, the fourth set of characters are digits and the fifth set of characters are upper case letters. The designations of the first, second, third and fourth scribing areas 501, 502, 503 and 504 are advised to a user by indicators 507, 508, 509 and 510 respectively. In alternative embodiments, the indicators 507, 508, 509 and 510 are marked on a housing of the electronic device 100 adjacent the first, second, third and fourth scribing areas 501, 502, 503 and 504 respectively. Alternatively, the indicators 507, 508, 509 and 510 may be activated and deactivated at the user's discretion. In a further embodiment, the indicators 507, 508, 509 and 510 are omitted.
With the user interface shown in FIG. 5, in one embodiment, test 303 to determine whether the scribed indicium 204 extends into more than one scribing area includes determining if the threshold value of at least 10% of the scribed indicium 204 is scribed in the first, second, third and fourth scribing areas 501, 502, 503, 504. If test 303 is satisfied, the method includes performing 304 large screen indicium character recognition by recognising the scribed indicium 204 as a candidate character from the third set of characters. If test 303 is not satisfied, the method includes performing 305 small indicium character recognition.
In an alternative embodiment, test 303 employs a threshold value of at least 75%, such that the method includes performing 304 large screen indicium character recognition when at least 75% of the scribed indicium 204 is scribed in the first scribing area 501, second scribing area 502, third scribing area 503 and fourth scribing area 504.
In the embodiments shown in FIGs. 2, 4 and 5, the touch screen 105 also comprises predictive display area 210. Once the scribed indicium 204 has been recognised and one or more candidate characters are displayed in the display area 205, predictive display area 210 displays one or more candidate characters that may follow the one or more candidate characters displayed in display area 205 to form a word, or part thereof, or to form a sound, in a particular language. Recognition of the scribed indicium may include normalizing the scribed indicium 204 to provide a scaled indicium, which is compared with sets of templates for each set of characters. Recognition of the scribed indicium 204 may also include conversion of any curved indicium or parts thereof into straight lines. Both normalizing and conversion of the scribed indicium are well known to persons skilled in the art.
The present invention is therefore a method for performing automatic recognition of indicia of different sets of characters scribed on a touch screen of an electronic device in a single mode of operation without the need for a user to switch modes to scribe the indicia of different sets of characters. The user can therefore scribe upper and lower case letters, numbers, punctuation and ideographic characters whilst remaining in the same mode of the electronic device. Character recognition accuracy and speed are not degraded however, because of the provision of scribing areas designated to recognise indicia scribed therein as candidate characters from specific sets of characters. Furthermore, the problem of insufficient space to accommodate virtual buttons for all the different characters is obviated.
The above detailed description provides exemplary embodiments only and is not intended to limit the scope, applicability, or configuration of the present invention. Rather, the detailed description of the exemplary embodiments provides those skilled in the art with an enabling description for implementing the exemplary embodiments of the invention. It should be understood that various changes can be made in the function and arrangement of elements and operations without departing from the spirit and scope of the invention as set forth in the appended claims.

Claims

WE CLAIM:
1. A method for performing recognition of a scribed indicium on a user interface of an electronic device, the method comprising: receiving a scribed indicium scribed on the user interface, the user interface at least comprising a first scribing area and a second scribing area, the first scribing area being designated to recognise the indicium scribed therein as a candidate character from a first set of characters, the second scribing area being designated to recognise the indicium scribed therein as a candidate character from a second set of characters; and performing large screen indicium character recognition on the scribed indicium when the scribed indicium extends into more than one of the scribing areas, the performing being determined by recognising the scribed indicium as a candidate character from a third set of characters.
2. A method as claimed in claim 1, wherein the performing large screen indicium character recognition occurs when at least 10% of the scribed indicium is scribed in the first scribing area and the second scribing area.
3. A method as claimed in claim 1 , wherein the performing large screen indicium character recognition occurs when at least 25% of the scribed indicium is scribed in the first scribing area and the second scribing area.
4. A method as claimed in claim 1, further including performing small indicium character recognition when the scribed indicium is scribed only in the first scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters and when the scribed indicium is scribed only in the second scribing area, the performing being determined by recognising the scribed indicium as a candidate character from the second set of characters.
5. A method as claimed in claim 2, further including performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least 90% of the scribed indicium is scribed in the first scribing area and by recognising the scribed indicium as a candidate character from the second set of characters when at least 90% of the scribed indicium is scribed in the second scribing area.
6. A method as claimed in claim 3, further including performing small indicium character recognition, the performing being determined by recognising the scribed indicium as a candidate character from the first set of characters when at least 75% of the scribed indicium is scribed in the first scribing area and by recognising the scribed indicium as a candidate character from the second set of characters when at least 75% of the scribed indicium is scribed in the second scribing area.
7. A method as described in claim 1, wherein the first set of characters are punctuation, the second set of characters are alphanumeric characters and the third set of characters are ideographic characters.
8. A method as described in claim 1, wherein the user interface further comprises a third scribing area, the third scribing area being designated to recognise the indicium scribed therein as a candidate character from a fourth set of characters.
9. A method as described in claim 8, wherein the performing large screen indicium character recognition occurs when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area and the third scribing area.
10. A method as described in claim 8, wherein the first set of characters are punctuation, the second set of characters are letters, the third set of characters are ideographic characters and the fourth set of characters are digits.
11. A method as described in claim 8, wherein the user interface further comprises a fourth scribing area, the fourth scribing area being designated to recognise the indicium scribed therein as a candidate character from a fifth set of characters.
12. A method as described in claim 11, wherein the performing large screen indicium character recognition occurs when at least 10% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
13. A method as described in claim 11 , wherein the performing large screen indicium character recognition occurs when at least 75% of the scribed indicium is scribed in the first scribing area, the second scribing area, the third scribing area and the fourth scribing area.
14. A method as described in claim 11, wherein the first set of characters are punctuation, the second set of characters are lower case letters, the third set of characters are ideographic characters, the fourth set of characters are digits and the fifth set of characters are upper case letters.
15. A method as described in claim 1 , further including displaying in at least one of the scribing areas at least one character from the set of characters which the at least one scribing area is designated to recognise.
PCT/US2006/000947 2005-01-13 2006-01-11 Recognition of scribed indicium on a user interface WO2006076411A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200510004450.9 2005-01-13
CNA2005100044509A CN1804860A (en) 2005-01-13 2005-01-13 Identification of script signs on user interface

Publications (2)

Publication Number Publication Date
WO2006076411A2 true WO2006076411A2 (en) 2006-07-20
WO2006076411A3 WO2006076411A3 (en) 2006-12-21

Family

ID=36678155

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/000947 WO2006076411A2 (en) 2005-01-13 2006-01-11 Recognition of scribed indicium on a user interface

Country Status (2)

Country Link
CN (1) CN1804860A (en)
WO (1) WO2006076411A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9547840B2 (en) 2009-12-28 2017-01-17 Google Technology Holdings LLC Methods for associating objects on a touch screen using input gestures

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040009729A1 (en) * 2002-05-10 2004-01-15 Hill Ian Gregory Woven electronic textile, yarn and article
US20040140965A1 (en) * 2002-10-31 2004-07-22 Microsoft Corporation Universal computing device
US20040145574A1 (en) * 2003-01-29 2004-07-29 Xin Zhen Li Invoking applications by scribing an indicium on a touch screen
WO2004111921A1 (en) * 2003-06-12 2004-12-23 Motorola Inc Improved recognition for character input in an electronic device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040009729A1 (en) * 2002-05-10 2004-01-15 Hill Ian Gregory Woven electronic textile, yarn and article
US20040140965A1 (en) * 2002-10-31 2004-07-22 Microsoft Corporation Universal computing device
US20040145574A1 (en) * 2003-01-29 2004-07-29 Xin Zhen Li Invoking applications by scribing an indicium on a touch screen
WO2004111921A1 (en) * 2003-06-12 2004-12-23 Motorola Inc Improved recognition for character input in an electronic device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9547840B2 (en) 2009-12-28 2017-01-17 Google Technology Holdings LLC Methods for associating objects on a touch screen using input gestures

Also Published As

Publication number Publication date
WO2006076411A3 (en) 2006-12-21
CN1804860A (en) 2006-07-19

Similar Documents

Publication Publication Date Title
US7202802B2 (en) Reduced keypad
US8044937B2 (en) Text input method and mobile terminal therefor
US7443316B2 (en) Entering a character into an electronic device
EP1934688A2 (en) Entering text into an electronic device
US7969421B2 (en) Apparatus and method for inputting character using touch screen in portable terminal
US20040145574A1 (en) Invoking applications by scribing an indicium on a touch screen
US20120086663A1 (en) Mobile terminal, language setting program and language setting method
US20080136784A1 (en) Method and device for selectively activating a function thereof
US20110181535A1 (en) Portable electronic device and method of controlling device
KR20110012791A (en) Apparatus and method for character recognition and input using touch screen
US6943777B2 (en) Electronic device with user interface capability and method therefor
US7973764B2 (en) Switching between input modes in a limited input device
KR100651268B1 (en) Device and method for authenticating user in terminal
WO2006060263A2 (en) A method and device for performing ideographic character input
US20140289664A1 (en) Portable terminal device, non-transitory storage medium and method for suppressing implementation
KR20090049153A (en) Terminal with touchscreen and method for inputting letter
RU2314563C1 (en) Method for recognition of written symbols on user interface
JP5647393B2 (en) Display device and display method
US20070013667A1 (en) Electronic device and method for entering characters therein
WO2006076411A2 (en) Recognition of scribed indicium on a user interface
US20130157727A1 (en) Character input device, character input method, and character input program
EP3477458B1 (en) Electronic device and method of providing selectable keys of a keyboard
WO2004097618A2 (en) Allowing screen functions to share a common display are of a touch screen
KR100334817B1 (en) Method for displaying information in digital portable phone included touch scrren panel
KR101375013B1 (en) Electronic device and method for inputting korean vowels into such a device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06718062

Country of ref document: EP

Kind code of ref document: A2