US20200218363A1 - Mobile communication terminal and method therefor - Google Patents

Mobile communication terminal and method therefor Download PDF

Info

Publication number
US20200218363A1
US20200218363A1 US16/699,226 US201916699226A US2020218363A1 US 20200218363 A1 US20200218363 A1 US 20200218363A1 US 201916699226 A US201916699226 A US 201916699226A US 2020218363 A1 US2020218363 A1 US 2020218363A1
Authority
US
United States
Prior art keywords
keys
key
sub
display
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/699,226
Inventor
Romel Amineh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Conversant Wireless Licensing SARL
Original Assignee
Conversant Wireless Licensing SARL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conversant Wireless Licensing SARL filed Critical Conversant Wireless Licensing SARL
Priority to US16/699,226 priority Critical patent/US20200218363A1/en
Publication of US20200218363A1 publication Critical patent/US20200218363A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0236Character input methods using selection techniques to select from displayed items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/26Devices for calling a subscriber
    • H04M1/27Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467Methods of retrieving data
    • H04M1/27475Methods of retrieving data using interactive graphical means or pictorial representations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/26Devices for calling a subscriber
    • H04M1/27Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • Embodiments of the present invention relates to a mobile communication apparatus with an improved user interface, and an input method for a mobile communication apparatus.
  • This is normally coped with by using a menu system, where functions are accessed by navigating a menu system, normally hierarchical.
  • functions that are used often, and especially when a plurality of functions is to be operated in sequence the menu approach is not satisfactory for the user.
  • An example of this is text input.
  • multitap or predicting functions have been used, but still, there is a need for improvements, since the existing solutions are error prone.
  • an objective of embodiments of the invention is to solve or at least reduce the problems discussed above.
  • an objective is to provide an intuitive and efficient user interface and input approach for mobile communication apparatus.
  • a mobile communication apparatus comprising a processor and a touch sensitive display, wherein said touch sensitive display is arranged to, under control of said processor, display a touch keypad, comprising a set of keys, detect an object over one key of said set of keys, and display, upon detection of said object over said one key, a first sub-set of keys associated with a first set of sub-functions of said one key, wherein said sub-set of keys is arranged adjacent to said one key.
  • An advantage of this is that the sub-set of keys are arranged in direct vicinity to the first actuated key, and therefore the user can actuate the key associated with the sub-function both quickly and intuitively.
  • the touch sensitive display may further be arranged to, under control of said processor, detect an object over one key of said first sub-set of keys, and display, upon detection of said object over said one key of said first sub-set of keys, a second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys, wherein said second sub-set of keys is arranged adjacent to said one key of said first sub-set of keys.
  • the second set of sub-functions may relate hierarcically to one sub-function of said first set of sub-functions.
  • the first set of sub-functions may relate to a first application of said mobile communication apparatus and said second set of sub-functions may relate to a second application of said mobile communication apparatus.
  • the first set of sub-functions may be application dependent.
  • the second set of sub-functions may also be application dependent.
  • the first sub-set of keys associated with a first set of sub-functions of said one key may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application.
  • the second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application.
  • the touch sensitive display may further be arranged to, under control of said processor, move at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • the touch sensitive display may further be arranged to, under control of said processor, move at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • the touch sensitive display may further be arranged to, under control of said processor to scale down at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • the touch sensitive display may further be arranged under control of said processor to scale down at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • An advantage of this is that the mobile communication apparatus automatically makes room for the extra keys, such that they can be in direct vicinity of the first actuated key.
  • the touch sensitive display may be arranged to delay display of said first sub-set of keys until after a predetermined time of said detection.
  • the predetermined time may be set by the user, pre-set, or adapted according to determined user interaction speed history.
  • the touch sensitive display may be arranged to display said first sub-set of keys for a predetermined time after said detection ceases.
  • the predetermined time may be set by the user, pre-set, or adapted according to determined user interaction speed history.
  • the sub-functions may comprise alphanumeric input, mediaplayer input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof
  • the functions of the keys of the first set of keys, the first sub-set of keys, and the second sub-set of keys, respectively, are activated upon pressing a key.
  • the object may be a finger, a stylus, or a digitizer pen.
  • an input method for a mobile communication apparatus comprising a processor and a touch sensitive display, comprising the steps of:
  • the method may further comprise the steps of:
  • the method may further comprise the step of moving at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • the method may further comprise the step of moving at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • the method may further comprise the step of scaling down at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • the method may further comprise the step of scaling down at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • the step of detecting said object comprises detecting said object for a predetermined time before displaying said first sub-set of keys.
  • the method may further comprise the step of continuing displaying said first sub-set of keys for a predetermined time after detection of said finger ceases.
  • Activating of the functions of the keys of the first set of keys, the first sub-set of keys, and the second sub-set of keys, respectively, is performed when pressing a key.
  • the second set of sub-functions may relate hierarcically to one sub-function of said first set of sub-functions.
  • the first set of sub-functions may relate to a first application of said mobile communication apparatus and said second set of sub-functions may relate to a second application of said mobile communication apparatus.
  • the first set of sub-functions may be application dependent.
  • the first sub-set of keys associated with a first set of sub-functions of said one key may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application.
  • the second set of sub-functions may be application dependent.
  • the second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application.
  • the sub-functions may comprise alphanumeric input, mediaplayer input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof.
  • FIG. 1 is a schematic view of functional blocks of the present invention
  • FIGS. 2A, 2B, 3A, 3B, 4, 5, 6A, 6B, 7 and 8 illustrate examples according to different embodiments of the present invention
  • FIG. 9 is a flow chart illustrating the process according to an embodiment of the method according to the present invention.
  • FIGS. 10 and 11 are flow charts illustrating sub-processes according to embodiments of the present invention.
  • FIG. 1 schematically shows a mobile communication apparatus 100 according to an embodiment of the present invention. It should be noted that parts not contributing to the core of the invention are left out not to obscure the features of the present invention.
  • the mobile communication apparatus comprises a processor 102 , a user interface (UI) 104 , and a memory 106 .
  • the memory 106 holds, among other things, program code for operation of applications of the mobile communication apparatus.
  • the memory 106 also holds data used by the applications.
  • the memory 106 is depicted as a single unit.
  • the memory can be two or more units, and/or divided in partitions.
  • the processor 102 is arranged to control functions of the mobile communication apparatus 100 via connections between elements 104 , 106 , and 108 the control of the elements, which connections also depict signal transfer and information exchange.
  • the mobile communication apparatus 100 can further comprise a transceiver (not shown) connected to the processor 102 which is arranged to receive and transmit radio signals through an antenna (not shown).
  • the mobile communication apparatus can further comprise a rotating dial, a microphone, a speaker, and a buzzer. These elements are not shown in FIG. 1 not to obscure the core of the present invention. Further miscellaneous electronics, such as means for infrared data association, Bluetooth, wireless local area network, etc. can also be comprised.
  • embodiments of the present invention relate to the special features of the UI 104 , which comprises a touch sensitive display 108 which is arranged to display information which is controlled and provided by the processor 102 , and to detect and provide input information to the processor 102 .
  • the touch sensitive display 108 is arranged to detect both if a part of the display 108 is pressed, e.g. by a user's finger, and if an object, e.g. said finger, is held over a part of the display 108 .
  • the detection of the state where the object is held over a part of the display can be performed in one or more ways, e.g. capacitively detecting the object close to, i.e. hoovering over, the display, light touch of the screen, which can be performed by determining the force from the object against the display, etc.
  • the detection of pressing the part of the display is performed as conventional for touch sensitive displays.
  • the display 108 is arranged to display a touch keypad, i.e. a displayed image of a keypad where the areas of the display 108 where the keys of the displayed image of the keypad is mapped to, with aid of the ability of the touch sensitive display 108 to detect actuation by touching and/or pressing of the display 108 , which is used to operate the mobile communication apparatus 100 .
  • a touch keypad i.e. a displayed image of a keypad where the areas of the display 108 where the keys of the displayed image of the keypad is mapped to
  • UI 104 The features and function of the UI 104 are illustrated by a number of examples and embodiments with reference to FIGS. 2 to 8 . However, it should be noted that, due to the large number of possible use cases within the scope of the present invention, that alternatives to and combinations of the presented examples and embodiments are equally possible.
  • FIG. 2 a illustrates a mobile communication apparatus 200 comprising a speaker 202 , a microphone 204 , and a touch sensitive display 206 .
  • the mobile communication apparatus 200 can also comprise a large number of elements that are commonly used in mobile communication apparatuses, as discussed with reference to FIG. 1 , but these are not depicted in FIG. 2 a , as well as in the below discussed figures, not to obsure the essence of the present invention.
  • the touch sensitive display 206 displays an image of a keypad 208 comprising a set of keys 210 .
  • an object which can be a finger, a stylus, or a digitizer pen, over e.g.
  • a sub-set of keys 214 are displayed, as depicted in FIG. 2 b , adjacent to the key 212 .
  • the input functions of the letters “j”, “k”, and “l” can be associated with the keys 215 , 216 , 217 , respectively, of the sub-set of keys 214 .
  • the keys can comprise symbols related to functions of other applications, e.g. “ ⁇ ”, “ ⁇ ” and “>>” for “fast reverse”, “play”, “pause”, and “fast forward”, respecively, for a media player.
  • FIG. 3 a illustrates a mobile communication apparatus 300 where an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 302 , whereby a sub-set of keys 304 has been displayed adjacent to the key 302 .
  • the keys 306 of the sub-set of keys 304 can, as illustrated by the symbols “ ⁇ ”, “>”, and “>>” which commonly on at least consumer products mean “backward”, “forward”, and “fast forward”, respectively, be associated with a media player, an FM radio, a browser, or any other application where forward and backward navigation are provided, e.g. controlling listening to a voice mail.
  • These applications can sometimes provide more features than only “backward”, “forward”, and “fast forward”, e.g.
  • a second sub-set of keys 310 is displayed adjacent to the key 308 of the first sub-set of keys 304 , comprising keys 312 with, as illustrated by the symbols “ ⁇ ”, and “ ⁇ ”, which can mean “search/step backward”, and “(play) backward”, respectively.
  • neighbouring keys to the actual key i.e. the key over which the object has been detected
  • the keypad is an image provided on the touch sensitive display, and thus can a new image of an adapted keypad be provided, and the mapping of the positions of the keys on the display and the areas related to the touch sensitive function of the display are re-mapped to the new image. Examples of this are depicted in FIGS. 4 to 8 .
  • an object e.g. a finger, a stylus, or a digitizer pen
  • a sub-set of keys 402 has been displayed adjacent to the key 400 .
  • a neighbouring key 404 has been scaled down in size.
  • an object e.g. a finger, a stylus, or a digitizer pen
  • a sub-set of keys 502 has been displayed adjacent to the key 500 .
  • a neighbouring key 504 has been moved. In this case the neighbouring key 504 has been moved upwards, away from the sub-set of keys 502 .
  • the actual key i.e. the key over which the object has been detected
  • always remain in the same position such that the user experience the position of the object as the static point around which the surroundings change. This is to avoid that the key under the object, e.g. the finger, moves away, which would degrade usability.
  • neighbouring keys can change positions and sizes. It is also possible to entirely remove one or more neighbouring keys, if that is considered to improve the user interface.
  • an object e.g. a finger, a stylus, or a digitizer pen
  • a sub-set of keys 602 has been displayed adjacent to the key 600 .
  • a neighbouring key 604 has been both scaled down in size and moved.
  • the sub-functions of the sub-set of keys 602 are associated to contacts, e.g. in a phone book.
  • the three first names in the phone book for each of the letters “j”, “k”, and “l”, present on the key 600 are presented as keys 604 of the sub-set of keys.
  • first names could be construed to be either in alphabetical order, in a user defined order, or an order based on statistics, i.e. calling history.
  • the user can either press one of the keys 604 to access the contact, e.g. call or send a message to the contact, or hold the object over one key 606 of the keys 604 to get a second sub-set of keys 608 , as depicted in FIG. 6 b .
  • FIG. 6 b it can also be noted that the keys 604 of the first sub-set of keys 602 except the key 606 also are included in the “neighbouring keys” discussed with reference to FIGS. 4, 5, and 6 a above.
  • a plurality of keys 610 - 614 has been moved and/or scaled down in size.
  • an object e.g. a finger, a stylus, or a digitizer pen
  • FIG. 7 an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 700 , whereby a sub-set of keys 702 has been displayed adjacent to the key 700 .
  • a neighbouring key 704 has been scaled down in size.
  • the sub-set of keys 702 comprises two groups 706 , 708 of keys, each group 706 , 708 being associated to separate types of inputs, where the first group 706 , as illustrated by the symbols “ ⁇ ”, “>”, and “>>” which commonly on at least consumer products mean “backward”, “forward”, and “fast forward”, respectively, is associated with a media player, an FM radio, a browser, or any other application where forward and backward navigation are provided, e.g. controlling listening to a voice mail, and the second group 708 is associated with the letters “j”, “k”, and “l”, which could be any other symbols or strokes for languages not using latin characters, and functions and applications related to them, as discussed above with reference to FIGS. 2 and 6 .
  • the user can directly access a larger number of functions and/or applications.
  • FIG. 9 is a flow chart illustrating the method according to an embodiment of the present invention. Some steps can be performed in a different order than depicted, and some steps can be performed in parallel, as is common in real time systems. It should be noted that the features of the illustrated method are not essential for the invention unless explicitly stated. The depicted method should be considered as a most refined improvement from the essence of the invention. However, a touch keypad have to be displayed in a touch keypad displaying step 900 , a finger have to be detected over a key of the touch keypad in a detection step 902 , and upon detection, a first sub-set of keys has to be displayed in a first sub-set of keys displaying step 904 .
  • the touch keypad displaying step 900 comprises displaying a touch keypad, i.e. a displayed image of a keypad where the areas of the display where the keys of the displayed image of the keypad is mapped to, with aid of the ability of the touch sensitive display to detect actuation by touching and/or pressing of the display, which is used to operate the mobile communication apparatus.
  • the detection step 902 comprises detecting an object, which can be a finger, a stylus, or a digitizer pen, over a key of a set of keys provided on the displayed touch keypad.
  • the first sub-set of keys displaying step 904 comprises displaying a first sub-set of keys on the touch sensitive display, adjacent to the key in question in the detection step 902 .
  • the method can comprise at least one step 906 for detecting the object over one of the keys of the sub-set, wherein, upon detection, a further sub-set of keys is displayed adjacent to the key in question in step 906 in a display step 908 . Similar steps (not shown) are provided for each level of sub-set of keys.
  • Embodiments of the present invention radically improve usability of a mobile communication apparatus, and the usability is further improved by requiring that the object is detected during a predetermined time to avoid annoying and unintentional keys to show up. This is performed in a waiting step 903 , where the sub-set does not show up until the object is detected for the predetermined time. Otherwise, the method returns to the detection step 902 .
  • the similar approach applies to the detection of the object over the keys of the sub-set of keys in step 906 , where a similar waiting step 907 is inserted before the displaying step 908 .
  • the keys of the sub sets of keys are displayed for a certain time, not too short, not too long, before the keys are removed from the display if they are not pressed. Therefore, the displaying steps 904 , 908 for the sub-sets of keys can be adapted to only show the sub-sets of keys for predetermined times, respectively.
  • FIG. 10 is a flow chart of a sub-process, preferably running in parallel to the process described with reference to FIG. 9 , which copes with the available and many times limited display space.
  • the process checks if there is need for more space as the touch keypad is extended by sub-sets of keys. Therefore, the process can comprise a step for checking need for scaling the size of neighbouring keys to the key in question, as in the detection steps 902 , 906 discussed above with reference to FIG. 9 , as depicted by scaling check step 1000 . If scaling is determined to be needed, this is performed in a neighbouring key scaling step 1002 , where one or more neighbouring keys are scaled down in size.
  • the process can also/alternatively comprise a step for checking need for moving neighbouring keys to the key in question. This is performed in a moving check step 1004 , and if moving of neighbouring keys is needed, this is performed in a neighbouring key moving step 1006 .
  • the scaling and positions of the keys are preferably restored when there is no longer a need.
  • FIG. 11 is a flow chart illustrating the process of checking if any key is pressed and if it is, activating an associated function. This is performed in a conventional way and comprises a step of checking if and what key is pressed in a key press checking step 1100 , and an associated function activating step 1102 , and needs no further explanation.
  • FIG. 8 illustrates a mobile communication apparatus 800 where all of the features discussed with reference to FIGS. 2-7 are combined, and particularly that multiple of groups is used on one sub-set level, from which next level of sub-set, here associated with the key 802 with “j”, being a number of contacts with names starting with the letter. “J”.
  • FIG. 8 could also illustrate the mobile communication apparatus 800 , but where the next sub-set level associated with “j”, and the names “Jane”, “Jens”, “John”, and “Juha” are names on artists, albums, songs, images, or any other media content, and thereby illustrating a further improved input method for these types of applications, where the “two groups” of keys of the first sub-set of keys just are different inputs to the same application.

Abstract

An input method for a mobile communication apparatus, and such a mobile communication apparatus, which comprises a processor and a touch sensitive display, is disclosed. The invention particularly comprises displaying a touch keypad comprising a set of keys, detecting an object over one key of said set of keys, and displaying, upon detection of said object, a first sub-set of keys adjacent to said one key, wherein said sub-set of keys is associated with a first set of sub-functions of said one key.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 11/384,210, filed on Mar. 17, 2006, which is hereby incorporated by reference.
  • TECHNICAL FIELD
  • Embodiments of the present invention relates to a mobile communication apparatus with an improved user interface, and an input method for a mobile communication apparatus.
  • BACKGROUND OF THE INVENTION
  • A problem with mobile communication apparatuses, which nowadays comprise a huge number of functions, is that a large number of functions are to be controlled with a very limited number of input means, i.e. keys, rotating input means, joystick, etc. This is normally coped with by using a menu system, where functions are accessed by navigating a menu system, normally hierarchical. However, for functions that are used often, and especially when a plurality of functions is to be operated in sequence, the menu approach is not satisfactory for the user. An example of this is text input. In this case, multitap or predicting functions have been used, but still, there is a need for improvements, since the existing solutions are error prone. This may be solved, as in US 2005/0140659 A1, with a keypad comprising a number of ordinary keys and a number of extra keys, wherein the extra keys will get an adaptive function depending on actuation of the ordinary keys. This is used for text input, such that when e.g. the ordinary key for “2” is pressed, wherein the key for “2” also comprises alphanumeric symbols “a”, “b”, and “c”, the extra keys will get the function of “a”, “b”, and “c”, respectively. In this way, the user can easily select what alphanumeric symbol to be input. However, this approach is still not satisfactory for a number of reasons, e.g. the extra keys will take up precious space on the keypad when they are not used, the user has to move between the ordinary key set and the extra key set for each input, etc.
  • Therefore, there is a need for an improved way of input and activation of functions.
  • SUMMARY OF THE INVENTION
  • In view of the above, an objective of embodiments of the invention is to solve or at least reduce the problems discussed above. In particular, an objective is to provide an intuitive and efficient user interface and input approach for mobile communication apparatus.
  • According to a first aspect of the present invention, there is provided a mobile communication apparatus comprising a processor and a touch sensitive display, wherein said touch sensitive display is arranged to, under control of said processor, display a touch keypad, comprising a set of keys, detect an object over one key of said set of keys, and display, upon detection of said object over said one key, a first sub-set of keys associated with a first set of sub-functions of said one key, wherein said sub-set of keys is arranged adjacent to said one key.
  • An advantage of this is that the sub-set of keys are arranged in direct vicinity to the first actuated key, and therefore the user can actuate the key associated with the sub-function both quickly and intuitively.
  • The touch sensitive display may further be arranged to, under control of said processor, detect an object over one key of said first sub-set of keys, and display, upon detection of said object over said one key of said first sub-set of keys, a second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys, wherein said second sub-set of keys is arranged adjacent to said one key of said first sub-set of keys.
  • This way, the user is able to select among a larger number of functions in a structured way, which maintains the intuitivity of the handling of the mobile communication apparatus, although the number of functions is large.
  • The second set of sub-functions may relate hierarcically to one sub-function of said first set of sub-functions.
  • This improves the user's experience of the intuitive handling.
  • The first set of sub-functions may relate to a first application of said mobile communication apparatus and said second set of sub-functions may relate to a second application of said mobile communication apparatus.
  • This way, the user is able to select what application that is to be accessed directly from the keypad, without the need of first choosing this from a menu system.
  • The first set of sub-functions may be application dependent. The second set of sub-functions may also be application dependent. The first sub-set of keys associated with a first set of sub-functions of said one key may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application. Also, the second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application.
  • This enables a more specific presentation of sub-functions depending on the actual use of the mobile communication apparatus.
  • The touch sensitive display may further be arranged to, under control of said processor, move at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys. The touch sensitive display may further be arranged to, under control of said processor, move at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys. The touch sensitive display may further be arranged to, under control of said processor to scale down at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys. The touch sensitive display may further be arranged under control of said processor to scale down at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • An advantage of this is that the mobile communication apparatus automatically makes room for the extra keys, such that they can be in direct vicinity of the first actuated key.
  • This is enabled due to the adaptiveness of the nature of the touch keypad provided by the touch sensitive display.
  • The touch sensitive display may be arranged to delay display of said first sub-set of keys until after a predetermined time of said detection.
  • This enables that unintentional actuation of keys does not render in annoying pop-ups of extra key sets. The predetermined time may be set by the user, pre-set, or adapted according to determined user interaction speed history.
  • The touch sensitive display may be arranged to display said first sub-set of keys for a predetermined time after said detection ceases.
  • This enables a user to determine and actuate a desired key of the sub-set of keys for a time, or, if the user do not want to activate any of the functions, the sub-set of keys disappears again. This improves the user-friendlyness. The predetermined time may be set by the user, pre-set, or adapted according to determined user interaction speed history.
  • The sub-functions may comprise alphanumeric input, mediaplayer input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof
  • The functions of the keys of the first set of keys, the first sub-set of keys, and the second sub-set of keys, respectively, are activated upon pressing a key. The object may be a finger, a stylus, or a digitizer pen.
  • According to a second aspect of the present invention, there is provided an input method for a mobile communication apparatus comprising a processor and a touch sensitive display, comprising the steps of:
  • displaying a touch keypad comprising a set of keys,
  • detecting an object over one key of said set of keys, and
  • displaying, upon detection of said object, a first sub-set of keys adjacent to said one key, wherein said sub-set of keys is associated with a first set of sub-functions of said one key.
  • The method may further comprise the steps of:
  • detecting an object over one key of said first sub-set of keys, and
  • displaying, upon detection of said object, a second sub-set of keys adjacent to said one key of said first sub-set of keys, wherein said second sub-set of keys is associated with a second set of sub-functions of said one key of said first sub-set of keys.
  • The method may further comprise the step of moving at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • The method may further comprise the step of moving at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • The method may further comprise the step of scaling down at least one neighbouring key to said one key of said set of keys on said touch sensitive display to make room for said first sub-set of keys.
  • The method may further comprise the step of scaling down at least one neighbouring key to said one key of said first sub-set of keys on said touch sensitive display to make room for said second sub-set of keys.
  • The step of detecting said object comprises detecting said object for a predetermined time before displaying said first sub-set of keys.
  • The method may further comprise the step of continuing displaying said first sub-set of keys for a predetermined time after detection of said finger ceases.
  • Activating of the functions of the keys of the first set of keys, the first sub-set of keys, and the second sub-set of keys, respectively, is performed when pressing a key.
  • In general, the second set of sub-functions may relate hierarcically to one sub-function of said first set of sub-functions. The first set of sub-functions may relate to a first application of said mobile communication apparatus and said second set of sub-functions may relate to a second application of said mobile communication apparatus. The first set of sub-functions may be application dependent. The first sub-set of keys associated with a first set of sub-functions of said one key may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application. The second set of sub-functions may be application dependent. The second sub-set of keys associated with a second set of sub-functions of said one key of said first sub-set of keys may comprise a first group of keys associated with sub-functions related to a first application, and a second group of keys associated with sub-functions related to a second application. The sub-functions may comprise alphanumeric input, mediaplayer input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof.
  • The advantages of the second aspect of the present invention are essentially the same as of the first aspect of the present invention.
  • Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to “a/an/the [element, device, component, means, step, etc]” are to be interpreted openly as referring to at least one instance of said element, device, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated.
  • Other objectives, features and advantages of embodiments of the present invention will appear from the following detailed disclosure, from the attached dependent claims as well as from the drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above, as well as additional objects, features and advantages of the present invention, will be better understood through the following illustrative and non-limiting detailed description of preferred embodiments of the present invention, with reference to the appended drawings, where the same reference numerals will be used for similar elements, wherein:
  • FIG. 1 is a schematic view of functional blocks of the present invention;
  • FIGS. 2A, 2B, 3A, 3B, 4, 5, 6A, 6B, 7 and 8 illustrate examples according to different embodiments of the present invention;
  • FIG. 9 is a flow chart illustrating the process according to an embodiment of the method according to the present invention; and
  • FIGS. 10 and 11 are flow charts illustrating sub-processes according to embodiments of the present invention.
  • DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
  • FIG. 1 schematically shows a mobile communication apparatus 100 according to an embodiment of the present invention. It should be noted that parts not contributing to the core of the invention are left out not to obscure the features of the present invention. The mobile communication apparatus comprises a processor 102, a user interface (UI) 104, and a memory 106. The memory 106 holds, among other things, program code for operation of applications of the mobile communication apparatus. The memory 106 also holds data used by the applications. Here, the memory 106 is depicted as a single unit.
  • However, the memory can be two or more units, and/or divided in partitions. The processor 102 is arranged to control functions of the mobile communication apparatus 100 via connections between elements 104, 106, and 108 the control of the elements, which connections also depict signal transfer and information exchange. The mobile communication apparatus 100 can further comprise a transceiver (not shown) connected to the processor 102 which is arranged to receive and transmit radio signals through an antenna (not shown). The mobile communication apparatus can further comprise a rotating dial, a microphone, a speaker, and a buzzer. These elements are not shown in FIG. 1 not to obscure the core of the present invention. Further miscellaneous electronics, such as means for infrared data association, Bluetooth, wireless local area network, etc. can also be comprised. In particular, embodiments of the present invention relate to the special features of the UI 104, which comprises a touch sensitive display 108 which is arranged to display information which is controlled and provided by the processor 102, and to detect and provide input information to the processor 102. The touch sensitive display 108 is arranged to detect both if a part of the display 108 is pressed, e.g. by a user's finger, and if an object, e.g. said finger, is held over a part of the display 108. The detection of the state where the object is held over a part of the display can be performed in one or more ways, e.g. capacitively detecting the object close to, i.e. hoovering over, the display, light touch of the screen, which can be performed by determining the force from the object against the display, etc. The detection of pressing the part of the display is performed as conventional for touch sensitive displays.
  • The display 108 is arranged to display a touch keypad, i.e. a displayed image of a keypad where the areas of the display 108 where the keys of the displayed image of the keypad is mapped to, with aid of the ability of the touch sensitive display 108 to detect actuation by touching and/or pressing of the display 108, which is used to operate the mobile communication apparatus 100.
  • The features and function of the UI 104 are illustrated by a number of examples and embodiments with reference to FIGS. 2 to 8. However, it should be noted that, due to the large number of possible use cases within the scope of the present invention, that alternatives to and combinations of the presented examples and embodiments are equally possible.
  • FIG. 2a illustrates a mobile communication apparatus 200 comprising a speaker 202, a microphone 204, and a touch sensitive display 206. The mobile communication apparatus 200 can also comprise a large number of elements that are commonly used in mobile communication apparatuses, as discussed with reference to FIG. 1, but these are not depicted in FIG. 2a , as well as in the below discussed figures, not to obsure the essence of the present invention. The touch sensitive display 206 displays an image of a keypad 208 comprising a set of keys 210. When the touch sensitive display 206 detects an object, which can be a finger, a stylus, or a digitizer pen, over e.g. key 212 having the main function of input of the digit “5”, which normally also comprise the letters “j”, “k”, and “l”, or other symbols or strokes for languages not using latin characters, a sub-set of keys 214 are displayed, as depicted in FIG. 2b , adjacent to the key 212. In this example, the input functions of the letters “j”, “k”, and “l” can be associated with the keys 215, 216, 217, respectively, of the sub-set of keys 214. Alternatively, the keys can comprise symbols related to functions of other applications, e.g. “<<”, “∥” and “>>” for “fast reverse”, “play”, “pause”, and “fast forward”, respecively, for a media player. Other examples, such as “”, “”, and ”” for “back”, “forward”, and “home” for a browser application, “”, “”, “”, and “” for “send”, “delete”, “save”, and “map” for a messaging application, etc. are possible. The user can then press the one of the keys 215, 216, 217 to activate the desired function.
  • FIG. 3a illustrates a mobile communication apparatus 300 where an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 302, whereby a sub-set of keys 304 has been displayed adjacent to the key 302. The keys 306 of the sub-set of keys 304 can, as illustrated by the symbols “<<”, “>”, and “>>” which commonly on at least consumer products mean “backward”, “forward”, and “fast forward”, respectively, be associated with a media player, an FM radio, a browser, or any other application where forward and backward navigation are provided, e.g. controlling listening to a voice mail. These applications can sometimes provide more features than only “backward”, “forward”, and “fast forward”, e.g. search functions, step to next or previous track/album/frequency band/etc. Therefore, as depicted in the example of FIG. 3b , by detecting the object over key 308 of the sub-set of keys 304, a second sub-set of keys 310 is displayed adjacent to the key 308 of the first sub-set of keys 304, comprising keys 312 with, as illustrated by the symbols “<<”, and “<”, which can mean “search/step backward”, and “(play) backward”, respectively.
  • In the examples discussed herein, one or two levels of sub-sets of keys and associated sets of sub-functions have been illustrated. However, the number of levels according to the present invention is not limited. On the other hand, the number of levels are in practice limited, since the user interface and its display, and the need for a large number of levels are limited, and the usability of the mobile communication apparatus has to be considered.
  • To cope with limited space on the display of the mobile communication apparatus, neighbouring keys to the actual key, i.e. the key over which the object has been detected, can be moved and/or resized to make room for the additional sub-sets of keys. This is possible, since the keypad is an image provided on the touch sensitive display, and thus can a new image of an adapted keypad be provided, and the mapping of the positions of the keys on the display and the areas related to the touch sensitive function of the display are re-mapped to the new image. Examples of this are depicted in FIGS. 4 to 8.
  • In FIG. 4, an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 400, whereby a sub-set of keys 402 has been displayed adjacent to the key 400. To make room for the sub-set of keys 402, a neighbouring key 404 has been scaled down in size.
  • In FIG. 5, an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 500, whereby a sub-set of keys 502 has been displayed adjacent to the key 500. To make room for the sub-set of keys 502, a neighbouring key 504 has been moved. In this case the neighbouring key 504 has been moved upwards, away from the sub-set of keys 502.
  • In a preferred embodiment, the actual key, i.e. the key over which the object has been detected, always remain in the same position, such that the user experience the position of the object as the static point around which the surroundings change. This is to avoid that the key under the object, e.g. the finger, moves away, which would degrade usability.
  • Thus, the actual key remains the same, while neighbouring keys can change positions and sizes. It is also possible to entirely remove one or more neighbouring keys, if that is considered to improve the user interface.
  • In FIG. 6a , an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 600, whereby a sub-set of keys 602 has been displayed adjacent to the key 600. To make room for the sub-set of keys 602, a neighbouring key 604 has been both scaled down in size and moved. In this example, the sub-functions of the sub-set of keys 602 are associated to contacts, e.g. in a phone book. Here, the three first names in the phone book for each of the letters “j”, “k”, and “l”, present on the key 600 are presented as keys 604 of the sub-set of keys. In this context, “first names” could be construed to be either in alphabetical order, in a user defined order, or an order based on statistics, i.e. calling history. Here, the user can either press one of the keys 604 to access the contact, e.g. call or send a message to the contact, or hold the object over one key 606 of the keys 604 to get a second sub-set of keys 608, as depicted in FIG. 6b . In FIG. 6b , it can also be noted that the keys 604 of the first sub-set of keys 602 except the key 606 also are included in the “neighbouring keys” discussed with reference to FIGS. 4, 5, and 6 a above. It can also be noted that a plurality of keys 610-614 has been moved and/or scaled down in size. In FIG. 7, an object, e.g. a finger, a stylus, or a digitizer pen, has been detected over a key 700, whereby a sub-set of keys 702 has been displayed adjacent to the key 700. To make room for the sub-set of keys 702, a neighbouring key 704 has been scaled down in size.
  • The sub-set of keys 702 comprises two groups 706, 708 of keys, each group 706, 708 being associated to separate types of inputs, where the first group 706, as illustrated by the symbols “<<”, “>”, and “>>” which commonly on at least consumer products mean “backward”, “forward”, and “fast forward”, respectively, is associated with a media player, an FM radio, a browser, or any other application where forward and backward navigation are provided, e.g. controlling listening to a voice mail, and the second group 708 is associated with the letters “j”, “k”, and “l”, which could be any other symbols or strokes for languages not using latin characters, and functions and applications related to them, as discussed above with reference to FIGS. 2 and 6. By providing multiple groups 706, 708, with different associations, within a sub-set on a level of sub-sets, the user can directly access a larger number of functions and/or applications.
  • FIG. 9 is a flow chart illustrating the method according to an embodiment of the present invention. Some steps can be performed in a different order than depicted, and some steps can be performed in parallel, as is common in real time systems. It should be noted that the features of the illustrated method are not essential for the invention unless explicitly stated. The depicted method should be considered as a most refined improvement from the essence of the invention. However, a touch keypad have to be displayed in a touch keypad displaying step 900, a finger have to be detected over a key of the touch keypad in a detection step 902, and upon detection, a first sub-set of keys has to be displayed in a first sub-set of keys displaying step 904. The touch keypad displaying step 900 comprises displaying a touch keypad, i.e. a displayed image of a keypad where the areas of the display where the keys of the displayed image of the keypad is mapped to, with aid of the ability of the touch sensitive display to detect actuation by touching and/or pressing of the display, which is used to operate the mobile communication apparatus. The detection step 902 comprises detecting an object, which can be a finger, a stylus, or a digitizer pen, over a key of a set of keys provided on the displayed touch keypad. The first sub-set of keys displaying step 904 comprises displaying a first sub-set of keys on the touch sensitive display, adjacent to the key in question in the detection step 902.
  • As discussed above with reference to the examples depicted in FIGS. 2 to 8, there can be provided multiple levels of sub-steps. Therefore, the method can comprise at least one step 906 for detecting the object over one of the keys of the sub-set, wherein, upon detection, a further sub-set of keys is displayed adjacent to the key in question in step 906 in a display step 908. Similar steps (not shown) are provided for each level of sub-set of keys.
  • Embodiments of the present invention radically improve usability of a mobile communication apparatus, and the usability is further improved by requiring that the object is detected during a predetermined time to avoid annoying and unintentional keys to show up. This is performed in a waiting step 903, where the sub-set does not show up until the object is detected for the predetermined time. Otherwise, the method returns to the detection step 902. The similar approach applies to the detection of the object over the keys of the sub-set of keys in step 906, where a similar waiting step 907 is inserted before the displaying step 908.
  • Similarly, it is preferable that the keys of the sub sets of keys are displayed for a certain time, not too short, not too long, before the keys are removed from the display if they are not pressed. Therefore, the displaying steps 904, 908 for the sub-sets of keys can be adapted to only show the sub-sets of keys for predetermined times, respectively.
  • FIG. 10 is a flow chart of a sub-process, preferably running in parallel to the process described with reference to FIG. 9, which copes with the available and many times limited display space. In general, the process checks if there is need for more space as the touch keypad is extended by sub-sets of keys. Therefore, the process can comprise a step for checking need for scaling the size of neighbouring keys to the key in question, as in the detection steps 902, 906 discussed above with reference to FIG. 9, as depicted by scaling check step 1000. If scaling is determined to be needed, this is performed in a neighbouring key scaling step 1002, where one or more neighbouring keys are scaled down in size. The process can also/alternatively comprise a step for checking need for moving neighbouring keys to the key in question. This is performed in a moving check step 1004, and if moving of neighbouring keys is needed, this is performed in a neighbouring key moving step 1006. The scaling and positions of the keys are preferably restored when there is no longer a need.
  • FIG. 11 is a flow chart illustrating the process of checking if any key is pressed and if it is, activating an associated function. This is performed in a conventional way and comprises a step of checking if and what key is pressed in a key press checking step 1100, and an associated function activating step 1102, and needs no further explanation.
  • FIG. 8 illustrates a mobile communication apparatus 800 where all of the features discussed with reference to FIGS. 2-7 are combined, and particularly that multiple of groups is used on one sub-set level, from which next level of sub-set, here associated with the key 802 with “j”, being a number of contacts with names starting with the letter. “J”. On the other hand, FIG. 8 could also illustrate the mobile communication apparatus 800, but where the next sub-set level associated with “j”, and the names “Jane”, “Jens”, “John”, and “Juha” are names on artists, albums, songs, images, or any other media content, and thereby illustrating a further improved input method for these types of applications, where the “two groups” of keys of the first sub-set of keys just are different inputs to the same application. It should therefore be clear that the approach presented by the present invention can be combined in a multitude of ways. Thus, the invention has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope of the invention, as defined by the appended patent claims.

Claims (20)

1. An apparatus comprising:
at least one processor; and
at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
provide for display of a touch keypad on a touch sensitive display, comprising an original set of keys, each for activating a corresponding function;
receive an indication of an object detected at a first key of the set of keys, the indication indicating a force applied by the object against the display;
responsive to receiving the indication of the object at the first key at a first level of force, activate a function corresponding to the first key;
responsive to receiving the indication of the object detected at the first key at a second level of force, provide for display of a first sub-set of keys associated with a first set of sub-functions of the first key, wherein the first sub-set of keys is arranged adjacent to the first key so that one or more of the first sub-set of keys is nearer to the first key and nearer to at least one other of the first sub-set of keys than to any other key in the original set of keys, and includes a second key that was not included in the original set of keys; and
responsive to receiving an indication of an object detected at the second key, activate a sub-function corresponding to the second key;
wherein, while the first sub-set of keys is displayed, each of the original set of keys is displayed and can activate its corresponding function.
2. The apparatus of claim 1, wherein the first level of force corresponds to a press of the object against the display at the first key, and the second level of force corresponds to at most a light touch of the object against the display at the first key.
3. The apparatus of claim 2, wherein the second level of force corresponds to the object hovering over the display at the first key.
4. The apparatus of claim 2, wherein the display of the first sub-set of keys is provided responsive to the receiving of the indication of the object detected at the first key at a second level of force for at least a predetermined time.
5. The apparatus according to claim 1, wherein the first set of sub-functions comprises a first group of sub-functions related to a first application of the apparatus.
6. The apparatus of claim 1, wherein the first sub-set of keys is displayed between the first key and one or more neighboring keys in the original set of keys.
7. The apparatus according to claim 6, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:
provide for display of the first sub-set of keys by moving at least one neighboring key of the original set of keys relative to at least one of the other of the original set of keys on the touch sensitive display, while maintaining the first key in its previously displayed position;
wherein the first sub-set of keys is displayed between the first key and the moved neighboring key.
8. The apparatus according to claim 6, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to provide for display of the first sub-set of keys by:
resizing at least one neighboring key of the original set of keys relative to at least one of the other of the original set of keys on the touch sensitive display to display the neighboring key at a smaller size;
wherein the first sub-set of keys is displayed between the first key and the resized neighboring key.
9. The apparatus according to claim 1, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to provide for display of the first sub-set of keys by:
maintaining the display of the first sub-set of keys for a predetermined time after the indication of an object detected at the first key has ceased.
10. The apparatus according to claim 1, wherein the sub-functions comprise alphanumeric input, media player input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof.
11. A method comprising:
causing a touch keypad to be displayed on a touch sensitive display comprising an original set of keys, each for activating a corresponding function;
detecting an object at a first key of the original set of keys and determining a force of the detected object against the display at the first key;
responsive to the detected object at the first key being at a first level of force, activating a function corresponding to the first key;
responsive to the detected object at the first key being at a second level of force, causing a first sub-set of keys to be displayed adjacent to the first key, wherein the first sub-set of keys is associated with a first set of sub-functions of the first key so that one or more of the first sub-set of keys is nearer to the first key and nearer to at least one other of the first sub-set of keys than to any other key in the original set of keys, and includes a second key that was not included in the original set of keys; and
responsive to receiving an indication of an object detected at the second key, activating a sub-function corresponding to the second key;
wherein, while the first sub-set of keys is displayed, each of the original set of keys is displayed and can activate its corresponding function.
12. The method of claim 11, wherein the first level of force corresponds to a press of the object against the display at the first key, and the second level of force corresponds to at most a light touch of the object against the display at the first key.
13. The method of claim 12, wherein the second level of force corresponds to the object hovering over the display at the first key.
14. The method of claim 12, wherein the display of the first sub-set of keys is caused responsive to the receiving of the indication of the object detected at the first key at a second level of force for at least a predetermined time.
15. The method according to claim 1, wherein the first set of sub-functions comprises a first group of sub-functions related to a first application of the apparatus.
16. The method of claim 11, wherein the first sub-set of keys is displayed between the first key and one or more neighboring keys in the original set of keys.
17. The method according to claim 16, wherein the step of causing the first sub-set of keys to be displayed comprises:
moving at least one neighboring key of the original set of keys relative to at least one of the other of the original set of keys on the touch sensitive display, while maintaining the first key in its previously displayed position;
wherein the first sub-set of keys is displayed between the first key and the moved neighboring key.
18. The method according to claim 16, wherein the step of causing the first sub-set of keys to be displayed comprises:
resizing at least one neighboring key of the original set of keys relative to at least one of the other of the original set of keys on the touch sensitive display to display the neighboring key at a smaller size;
wherein the first sub-set of keys is displayed between the first key and the resized neighboring key.
19. The method according to claim 11, wherein the step of causing the first sub-set of keys to be displayed comprises:
maintaining the display of the first sub-set of keys for a predetermined time after the indication of the object detected at the first key has ceased.
20. The method according to claim 11, wherein the sub-functions comprise alphanumeric input, media player input, short-cuts to applications, functions or contacts, or browser input, or any combination thereof.
US16/699,226 2006-03-17 2019-11-29 Mobile communication terminal and method therefor Abandoned US20200218363A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/699,226 US20200218363A1 (en) 2006-03-17 2019-11-29 Mobile communication terminal and method therefor

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/384,210 US10521022B2 (en) 2006-03-17 2006-03-17 Mobile communication terminal and method therefor
US16/699,226 US20200218363A1 (en) 2006-03-17 2019-11-29 Mobile communication terminal and method therefor

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/384,210 Continuation US10521022B2 (en) 2006-03-17 2006-03-17 Mobile communication terminal and method therefor

Publications (1)

Publication Number Publication Date
US20200218363A1 true US20200218363A1 (en) 2020-07-09

Family

ID=38069109

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/384,210 Expired - Fee Related US10521022B2 (en) 2006-03-17 2006-03-17 Mobile communication terminal and method therefor
US16/699,226 Abandoned US20200218363A1 (en) 2006-03-17 2019-11-29 Mobile communication terminal and method therefor

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/384,210 Expired - Fee Related US10521022B2 (en) 2006-03-17 2006-03-17 Mobile communication terminal and method therefor

Country Status (5)

Country Link
US (2) US10521022B2 (en)
EP (1) EP2013689A1 (en)
JP (2) JP2009530944A (en)
CN (1) CN101390033B (en)
WO (1) WO2007107824A1 (en)

Families Citing this family (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
US20100026652A1 (en) * 2005-09-01 2010-02-04 David Hirshberg System and method for user interface
JP5119763B2 (en) * 2007-06-25 2013-01-16 日本電気株式会社 Information device provided with touch panel, icon selection method and program used therefor
US9954996B2 (en) 2007-06-28 2018-04-24 Apple Inc. Portable electronic device with conversation management for incoming instant messages
JP5207699B2 (en) * 2007-09-28 2013-06-12 京セラ株式会社 Character input device, character input method, and character input program
KR100949581B1 (en) * 2007-10-08 2010-03-25 주식회사 자코드 Apparatus and method for inputting character and numeral on communication device
US8369900B2 (en) * 2007-10-18 2013-02-05 Nec Corporation Mobile terminal and display method of operational section
US8265689B2 (en) * 2007-12-28 2012-09-11 Google Inc. Multi-tapping numpad
JP2009169456A (en) * 2008-01-10 2009-07-30 Nec Corp Electronic equipment, information input method and information input control program used for same electronic equipment, and portable terminal device
US20090187840A1 (en) * 2008-01-17 2009-07-23 Vahid Moosavi Side-bar menu and menu on a display screen of a handheld electronic device
EP2081110A1 (en) * 2008-01-17 2009-07-22 Research In Motion Limited Side-bar menu and menu on a display screen of a handheld electronic device
EP2085865A1 (en) 2008-01-30 2009-08-05 Research In Motion Limited Electronic device and method of controlling the same
KR101486345B1 (en) * 2008-03-21 2015-01-26 엘지전자 주식회사 Mobile terminal and screen displaying method thereof
KR101513023B1 (en) * 2008-03-25 2015-04-22 엘지전자 주식회사 Terminal and method of displaying information therein
KR101012379B1 (en) * 2008-03-25 2011-02-09 엘지전자 주식회사 Terminal and method of displaying information therein
US20100085313A1 (en) * 2008-10-07 2010-04-08 Research In Motion Limited Portable electronic device and method of secondary character rendering and entry
EP2175355A1 (en) 2008-10-07 2010-04-14 Research In Motion Limited Portable electronic device and method of secondary character rendering and entry
EP2350786A4 (en) * 2008-10-15 2012-06-13 Inputive Corp System and method for seamlessly integrated navigation of applications
US20100110002A1 (en) * 2008-11-06 2010-05-06 Sony Ericsson Mobile Communications Ab Communication device with combined input and display device
CN102257465A (en) * 2008-12-19 2011-11-23 尤纳生物工程私人有限公司 Systems and methods for text input for touch-typable
US8605039B2 (en) * 2009-03-06 2013-12-10 Zimpl Ab Text input
US20100293457A1 (en) * 2009-05-15 2010-11-18 Gemstar Development Corporation Systems and methods for alphanumeric navigation and input
US9317116B2 (en) * 2009-09-09 2016-04-19 Immersion Corporation Systems and methods for haptically-enhanced text interfaces
WO2011056610A2 (en) * 2009-10-26 2011-05-12 Google Inc. Predictive text entry for input devices
JP2011118507A (en) * 2009-12-01 2011-06-16 Mitsubishi Electric Corp Character input device
JP5126247B2 (en) * 2010-02-24 2013-01-23 ブラザー工業株式会社 Data input device
JP5126246B2 (en) * 2010-02-24 2013-01-23 ブラザー工業株式会社 Data input device
CN102193641B (en) 2010-03-09 2014-06-18 阿里巴巴集团控股有限公司 Method and device for displaying candidate characters in character inputting process
BR112012029421A2 (en) * 2010-05-24 2017-02-21 John Temple Will multidirectional button, key and keyboard
JP5630160B2 (en) * 2010-09-07 2014-11-26 ソニー株式会社 Information processing apparatus, information processing method, and computer program
FR2971066B1 (en) 2011-01-31 2013-08-23 Nanotec Solution THREE-DIMENSIONAL MAN-MACHINE INTERFACE.
WO2012110678A1 (en) * 2011-02-15 2012-08-23 Nokia Corporation Displaying a panel
US10275153B2 (en) * 2011-05-19 2019-04-30 Will John Temple Multidirectional button, key, and keyboard
US8971924B2 (en) 2011-05-23 2015-03-03 Apple Inc. Identifying and locating users on a mobile network
US10715380B2 (en) 2011-05-23 2020-07-14 Apple Inc. Setting a reminder that is triggered by a target user device
KR101878141B1 (en) * 2011-05-30 2018-07-13 엘지전자 주식회사 Mobile terminal and method for controlling thereof
US8754861B2 (en) * 2011-07-06 2014-06-17 Google Inc. Touch-screen keyboard facilitating touch typing with minimal finger movement
JP5510473B2 (en) * 2012-02-02 2014-06-04 富士通株式会社 Character input device, character input method, and character input program
CN102799347B (en) * 2012-06-05 2017-01-04 北京小米科技有限责任公司 User interface interaction method and device applied to touch screen equipment and touch screen equipment
KR101370834B1 (en) 2012-10-18 2014-03-07 삼성전자주식회사 Display apparatus and method for inputting characters thereof
JP5542906B2 (en) * 2012-12-25 2014-07-09 京セラ株式会社 Character input device, character input method, and character input program
CN103049210A (en) * 2013-01-07 2013-04-17 东莞宇龙通信科技有限公司 Terminal and centralized control area display method
US8989773B2 (en) 2013-01-29 2015-03-24 Apple Inc. Sharing location information among devices
FR3002052B1 (en) 2013-02-14 2016-12-09 Fogale Nanotech METHOD AND DEVICE FOR NAVIGATING A DISPLAY SCREEN AND APPARATUS COMPRISING SUCH A NAVIGATION
KR20140115060A (en) * 2013-03-20 2014-09-30 한국전자통신연구원 Method for inputting text and apparatus for performing the same
US20140317564A1 (en) * 2013-04-23 2014-10-23 Synaptics Incorporated Navigation and language input using multi-function key
CN103294222B (en) * 2013-05-22 2017-06-16 小米科技有限责任公司 A kind of input method and system
KR102157264B1 (en) 2013-10-30 2020-09-17 삼성전자주식회사 Display apparatus and UI providing method thereof
US10382378B2 (en) 2014-05-31 2019-08-13 Apple Inc. Live location sharing
US20150350141A1 (en) 2014-05-31 2015-12-03 Apple Inc. Message user interfaces for capture and transmittal of media and location content
WO2016022496A2 (en) 2014-08-06 2016-02-11 Apple Inc. Reduced-size user interfaces for battery management
KR102143308B1 (en) 2014-09-02 2020-08-10 애플 인크. Reduced-size interfaces for managing alerts
CN115665320A (en) 2014-09-02 2023-01-31 苹果公司 Telephone user interface
KR102376700B1 (en) * 2015-08-12 2022-03-22 삼성전자주식회사 Method and Apparatus for Generating a Video Content
US10003938B2 (en) 2015-08-14 2018-06-19 Apple Inc. Easy location sharing
JP6620480B2 (en) * 2015-09-15 2019-12-18 オムロン株式会社 Character input method, character input program, and information processing apparatus
JP6208808B2 (en) * 2016-05-06 2017-10-04 京セラ株式会社 Character input device, character input method, and character input program
US11079913B1 (en) 2020-05-11 2021-08-03 Apple Inc. User interface for status indicators
CN114981769A (en) * 2021-08-30 2022-08-30 武汉联影医疗科技有限公司 Information display method and device, medical equipment and storage medium

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3546337B2 (en) * 1993-12-21 2004-07-28 ゼロックス コーポレイション User interface device for computing system and method of using graphic keyboard
JPH08123647A (en) * 1994-10-25 1996-05-17 Sharp Corp Information processor
US6073036A (en) * 1997-04-28 2000-06-06 Nokia Mobile Phones Limited Mobile station with touch input having automatic symbol magnification function
JPH10312261A (en) * 1997-05-13 1998-11-24 Kawasaki Mutsuko Input method and device for selection menu
US7614008B2 (en) * 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US7760187B2 (en) * 2004-07-30 2010-07-20 Apple Inc. Visual expander
JP3475069B2 (en) * 1998-02-23 2003-12-08 三洋電機株式会社 Operation key display method and information processing device
CN1324464A (en) * 1998-08-26 2001-11-28 西姆泰克有限公司 Method and devices for mapping data files
JP2000181608A (en) 1998-12-17 2000-06-30 Sharp Corp Virtual input device
US6278887B1 (en) * 1999-02-05 2001-08-21 Neopoint, Inc. System and method for power conservation in a wireless communication handset
US6801190B1 (en) * 1999-05-27 2004-10-05 America Online Incorporated Keyboard system with automatic correction
US7134095B1 (en) * 1999-10-20 2006-11-07 Gateway, Inc. Simulated three-dimensional navigational menu system
JP2002041205A (en) 2000-07-21 2002-02-08 Matsushita Electric Ind Co Ltd Information display method for personal digital assistance(pda)
EP1195673B1 (en) 2000-10-04 2007-05-09 Siemens Aktiengesellschaft Automotive multimedia system with animated display function
JP2002358162A (en) 2001-06-01 2002-12-13 Sony Corp Picture display device
JP3747404B2 (en) 2001-06-19 2006-02-22 インターナショナル・ビジネス・マシーンズ・コーポレーション Graphics image creating apparatus, method and program thereof
FI116591B (en) * 2001-06-29 2005-12-30 Nokia Corp Method and apparatus for performing a function
JP4096541B2 (en) 2001-10-01 2008-06-04 株式会社日立製作所 Screen display method
US7113172B2 (en) * 2001-11-09 2006-09-26 Lifescan, Inc. Alphanumeric keypad and display system and method
JP2003177848A (en) 2001-12-12 2003-06-27 Hitachi Kokusai Electric Inc Key display method and character inputting device for software keyboard
US7002553B2 (en) 2001-12-27 2006-02-21 Mark Shkolnikov Active keyboard system for handheld electronic devices
GB0201074D0 (en) * 2002-01-18 2002-03-06 3G Lab Ltd Graphic user interface for data processing device
KR100941948B1 (en) 2002-05-21 2010-02-11 코닌클리케 필립스 일렉트로닉스 엔.브이. A system for selecting and entering objects and a method for entering objects from a set of objects and compuetr readable medium for storing software code for implementing the method
JP2004021522A (en) 2002-06-14 2004-01-22 Sony Corp Apparatus, method, and program for information processing
JP2004038894A (en) 2002-06-28 2004-02-05 Clarion Co Ltd Display control device
US8042044B2 (en) 2002-11-29 2011-10-18 Koninklijke Philips Electronics N.V. User interface with displaced representation of touch area
US6927763B2 (en) 2002-12-30 2005-08-09 Motorola, Inc. Method and system for providing a disambiguated keypad
JP3945445B2 (en) 2003-04-21 2007-07-18 ソニー株式会社 Display method and display device
JP2005092441A (en) 2003-09-16 2005-04-07 Aizu:Kk Character input method
US20050071778A1 (en) * 2003-09-26 2005-03-31 Nokia Corporation Method for dynamic key size prediction with touch displays and an electronic device using the method
EP1745348A1 (en) 2004-04-12 2007-01-24 Matsushita Electric Industries Co., Ltd. Data input method and apparatus
US7417625B2 (en) 2004-04-29 2008-08-26 Scenera Technologies, Llc Method and system for providing input mechanisms on a handheld electronic device
JP5132028B2 (en) * 2004-06-11 2013-01-30 三菱電機株式会社 User interface device
US20060007178A1 (en) * 2004-07-07 2006-01-12 Scott Davis Electronic device having an imporoved user interface
US7653883B2 (en) * 2004-07-30 2010-01-26 Apple Inc. Proximity detector in handheld device
WO2006028154A1 (en) * 2004-09-09 2006-03-16 Kyoto University Information management system, information management method, information management program, and recording medium
CA2531132C (en) * 2004-12-20 2013-04-02 Arnaud Nonclercq Method and system for graphically navigating among stored objects
US7616191B2 (en) * 2005-04-18 2009-11-10 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Electronic device and method for simplifying text entry using a soft keyboard
US7443316B2 (en) * 2005-09-01 2008-10-28 Motorola, Inc. Entering a character into an electronic device
US20070152980A1 (en) * 2006-01-05 2007-07-05 Kenneth Kocienda Touch Screen Keyboards for Portable Electronic Devices

Also Published As

Publication number Publication date
US20070216659A1 (en) 2007-09-20
CN101390033A (en) 2009-03-18
JP2012053921A (en) 2012-03-15
WO2007107824A1 (en) 2007-09-27
JP2009530944A (en) 2009-08-27
EP2013689A1 (en) 2009-01-14
CN101390033B (en) 2015-05-13
US10521022B2 (en) 2019-12-31

Similar Documents

Publication Publication Date Title
US20200218363A1 (en) Mobile communication terminal and method therefor
US8589823B2 (en) Application user interface with navigation bar showing current and prior application contexts
US10075579B2 (en) Mobile terminal, user interface method in the mobile terminal, and cover of the mobile terminal
US8264471B2 (en) Miniature character input mechanism
US8179371B2 (en) Method, system, and graphical user interface for selecting a soft keyboard
US7956846B2 (en) Portable electronic device with content-dependent touch sensitivity
US8610669B2 (en) Apparatus and method for inputting character using touch screen in portable terminal
US20160077692A1 (en) Menu executing method and apparatus in portable terminal
US20160210042A1 (en) Touch screen device, method, and graphical user interface for inserting a character from an alternate keyboard
US20080297485A1 (en) Device and method for executing a menu in a mobile terminal
US20100088598A1 (en) Function execution method and mobile terminal operating with the same
US20130082824A1 (en) Feedback response
EP2565769A2 (en) Apparatus and method for changing an icon in a portable terminal
US20110115722A1 (en) System and method of entering symbols in a touch input device
CN104834439A (en) Display information
CN104541239A (en) Text select and enter
US20130107673A1 (en) Mobile terminal and method of setting alarm therein
EP1864477A1 (en) Improved mobile communication terminal and method
US20100099448A1 (en) Method and apparatus for inputting receiver information of text message
JP4796131B2 (en) Method, electronic device and computer-readable recording medium for data management in an electronic device in response to user instructions by writing and / or audible sound
WO2006060263A2 (en) A method and device for performing ideographic character input
KR101483302B1 (en) Method of controlling operation of mobile telephone by using touch-screen
KR100677072B1 (en) Apparatus for user interface for icon moving in handheld device and method thereof

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION