WO2002013001A2 - Allocation of labels to associated user input elements - Google Patents

Allocation of labels to associated user input elements Download PDF

Info

Publication number
WO2002013001A2
WO2002013001A2 PCT/GB2001/002889 GB0102889W WO0213001A2 WO 2002013001 A2 WO2002013001 A2 WO 2002013001A2 GB 0102889 W GB0102889 W GB 0102889W WO 0213001 A2 WO0213001 A2 WO 0213001A2
Authority
WO
WIPO (PCT)
Prior art keywords
display
user input
data
input elements
labels
Prior art date
Application number
PCT/GB2001/002889
Other languages
French (fr)
Other versions
WO2002013001A3 (en
Inventor
Richard Jelbert
Original Assignee
Argo Interactive Group Plc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Argo Interactive Group Plc filed Critical Argo Interactive Group Plc
Publication of WO2002013001A2 publication Critical patent/WO2002013001A2/en
Publication of WO2002013001A3 publication Critical patent/WO2002013001A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238—Programmable keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72466—User interfaces specially adapted for cordless or mobile telephones with selection means, e.g. keys, having functions defined by the mode or the status of the device

Definitions

  • This invention relates to the allocation of labels to associated user input elements.
  • Examples of such device types are mobile telephones and personal organisers.
  • the present invention provides a method of generating display data for driving a display from source data, said display data including one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising the steps of: identifying within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating display data including labels associated with respective user input elements in accordance with said mapping.
  • the invention recognises that it is possible to generate display data that uses the soft key capabilities of a device without having to write special source data if instead predetermined rules are used to map the input label tags to appropriate user input elements in accordance with variable mapping control data.
  • the mapping control data can specify the particular target device.
  • the mapping data can specify different user options on a single target device type, such as options modifying the allocations of soft keys to suit left handed or right handed use.
  • the labels to be associated with the user input elements could be text labels, icons, graphics or other entities for identifying the input elements to a user.
  • the user input elements could be physical keys or areas upon a touch sensitive display or other manually operable user inputs.
  • the predetermined rules and the mapping control data could take many forms, it is preferred that the input label tags should have associated priorities controlling the order in which they are allocated to the available soft keys.
  • the soft keys are allocated in preferred embodiments in which the input label tags have associated preferred relative location data indicating one or a sequence of preferred locations of the soft key that should be allocated to that input label tag.
  • a key and its label may be allocated to the most logical position e.g. a top button can be placed at the top of the display and a bottom button placed at the bottom of a display.
  • the predetermined rules seek to allocate the relative positions of the elements within a grouped pair in accordance with a sequence of preferences that tries to place the elements in the most logical and easy to operate positions for a particular user.
  • the present invention may be used upon a wide variety of source data material (such as any mark-up language document), it is particularly useful in the context of displaying and interacting with internet webpages. Furthermore, the invention is particularly useful in the context of portable internet access devices such as wireless telephones.
  • the present invention provides an apparatus for generating display data for driving a display from source data, said display data including one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising: identifying logic operable to identify within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping logic operable to map identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating logic operable to generate display data including labels associated with respective user input elements in accordance with said mapping.
  • the invention also provides a computer program media bearing a computer program for controlling generation of display data in accordance with the above described techniques.
  • Figure 1 illustrates a mobile telephone incorporating soft keys
  • Figures 2A, 2B and 2C indicate a portable internet access device displaying labels for a plurality of soft keys in accordance with differing mapping control data
  • Figures 3 and 4 illustrate a personal digital assistant displaying a webpage and respectively configured for a right handed user and a left handed user;
  • Figure 5 is a simplified flow diagram illustrating the method of allocating labels to soft keys;
  • Figure 6 illustrates the sequence of preferred relative locations of elements within pairs of elements for two different types of pairs of elements.
  • Figure 7 illustrates a data processing apparatus for implementing the techniques described in relation to Figures 1 to 6.
  • Figure 1 shows a mobile telephone 2 including a display 4.
  • the mobile telephone 2 includes a first soft key 6 and a second soft key 8.
  • the first soft key 6 has an associated label 10
  • the second soft key 8 has an associated label 12.
  • the label is text, but it will be understood that the label could have a variety of other forms such as an icon, a graphic, etc.
  • the mobile telephone 2 is one that provides mobile internet access. Prior to display, the source data forming the internet webpage is searched for tags identifying soft keys and their labels. In this instance the number of soft keys available is very limited and so only the two highest priority soft keys can be allocated. In the example shown and for the particular webpage (or other mark-up language document) being displayed the highest priority soft keys correspond to the functions "Yes" and "No". For a right handed user who will typically operate the soft keys with their right thumb, it is most intuitive that the first key 6 should be allocated the function of "Yes" and the second key 8 should be allocated the function "No". For a left handed user who would operate the soft keys 6, 8 with their left thumb, then the labels 10, 12 may be reversed.
  • Figures 2 A, 2B and 2C all illustrate a mobile internet access device 14 having eight soft keys with associated labels.
  • the user options have been set to specify a right handed user. Accordingly, the interface is made most intuitive and usable if the highest priority soft keys and labels are associated with the top right hand soft keys with priority decreasing upon moving downwards and leftwards. For a left handed user, then highest priority soft keys would be allocated in the top left hand corner with the priority decreasing upon moving downwards and rightwards.
  • the input label tags within the source data indicate that the soft key pairs should be allocated in the priority order shown in the list of Figure 2A.
  • the highest priority pair of soft keys is the Yes/No pair. This pair has associated relative location data indicating that it is most intuitive for a user for the Yes key to be placed horizontally to the right of the No key. Accordingly, these soft keys are respectively allocated to the top right hand key and the top left hand key.
  • the following pair of soft keys in the priority order are the Next/Previous soft keys that are also specified as preferably being horizontally relatively located with the Next key being allocated to the second highest key on the right hand side and the Previous key being allocated to the second highest key on the left hand side.
  • the OK and Cancel keys that are accordingly allocated to the third highest soft key on the right hand side and the third highest soft key on the left hand side.
  • Figure 2B illustrates display of the same webpage and soft keys except that the priority ordering has been altered.
  • the highest priority soft key pair is the Top key and the Bottom key and accordingly these are allocated to the right hand upper most two soft keys.
  • the next soft key pair is the Yes and No soft keys.
  • the top preference for the relative location of these keys is horizontally adjacent one another with the Yes key to the right of the No key for a right handed user. Accordingly, these are allocated to the third highest soft key on the right hand side and the third highest soft key on the left hand side respectively.
  • the next highest priority soft key pair is the Next key and the Previous key.
  • the only available horizontally pair of unallocated soft keys is not the lowermost pair of soft keys.
  • the Next key is allocated to the lowermost right hand soft key and the Previous key is allocated to the lower most left hand soft key.
  • the one remaining soft key pair to be allocated is the OK key and the Cancel key. Whilst the first preference for these keys is that the OK key should be to the right of the Cancel key, this is no longer a possibility and accordingly the second preference of the OK key being above the Cancel key is adopted.
  • Figure 2C illustrates a further example in which the first and second priority soft key pairs are allocated their preferred relative horizontal locations and the third highest priority soft key pair is allocated its preferred location of vertically adjacent soft keys.
  • the final soft key pair of the Yes key and the No key has a first preference relative location of the Yes key being to the right of the No key, but this is no longer available and so the second preference of the Yes key being vertically above the No key is adopted.
  • Figures 3 and 4 illustrate a personal digital assistant 16 displaying the same internet webpage but in accordance with respective configurations for a right handed user and a left handed user.
  • Further input label tags within the source data that are found once all of the available soft keys are allocated are in this case allocated to hypertext links 30.
  • All of the pairs of soft keys Yes/No OK/Cancel and Next/Previous that are allocated soft keys are ones in which the first order preference for a right handed user is with the first element horizontally to the right of the second element.
  • the user option data specifies a left handed user, then this is reversed with the first choice relative location being with the first element to the left of the second element.
  • these are not allocated horizontally adjacent soft keys in either example and the vertical relative positions of these two soft keys are accordingly unchanged by the right hand and left hand user option.
  • Figure 5 illustrates a flow diagram of the technique of the present invention.
  • a page of source data representing an internet webpage is fetched.
  • This source data contains input label text specifying soft keys and soft key pairs to be allocated together with their respective labels, relative priorities and sequence of preferred relative positions.
  • step 34 details are fetched of the target device upon which the source data is to be displayed.
  • step 36 user preferences, such as right handedness or left handedness are fetched.
  • step 38 the source page is parsed to identify the input label tags within the page.
  • step 40 the number and ordering of the desired soft keys identified at step 38 is established.
  • the soft keys are allocated to the available physical keys or touch screen areas of the target device in accordance with their relative priority ordering and the relative position preferences associated with each input label tag.
  • any remaining tags that have not been allocated to physical keys or touch screen areas are allocated to hypertext links that are inserted into the webpage to be displayed.
  • Figure 6 illustrates the sequence of relative position preferences for soft key pairs.
  • the soft key pair is one in which the highest preference is for one of the keys to be displayed vertically above the other key.
  • the next preference is for the first key to be displayed to the right of the second key, the third preference is for the first key to be displayed above and to the right of the second key and the final preference is for the first key to be displayed above and to the left of the second key. If none of these preferences turns out to be available, then the keys can simply be allocated in turn to whatever soft keys, if any, remain.
  • the lower example of Figure 6 illustrates a soft key pairing which the highest preference is for the first key to be displayed horizontally to the right of the second key.
  • the second preference is for the first key to be displayed vertically above the second key
  • the third preference is for the first key to be displayed above and to the right of the second key
  • the fourth preference is for the first key to be displayed below and to the right of the second key.
  • Both of the examples illustrated in Figure 6 are for a right handed user.
  • the predetermined rule is modified such that the right hand positions and left hand positions in both of these examples, where applicable, are reversed.
  • FIG. 7 illustrates a data processing apparatus, in this case the elements of a mobile telephone, for performing the above described techniques.
  • the telephone includes a central processing unit 46, a read only memory 48, a random access memory 50, a wireless interface unit 52, a display driver 54 with associated display 56 and a user input unit 58 with associated physical soft keys 60 and touch sensitive areas 62.
  • the central processing unit 46 executes a computer program stored within the read only memory 48 using the random access memory 50 as its working memory.
  • Internet webpages received via the wireless interface unit 52 are processed to adapt them to the display capabilities and user option preferences of the particular device.
  • This processing allocates soft keys identified by input label tags within the source data to available physical keys 60 and touch sensitive areas 62.
  • the processing to adapt the source data for a particular display 56 may instead be performed at the source server or a proxy server rather than at the client device. Accordingly, a mobile telephone could log into a proxy server and identify itself as a particular type of device. The user identifier and password could be used to access particular user preferences, such as indicating whether the user had specified right handed or left handed use.
  • the proxy server via which the device had connected could then act to receive internet webpages from any other remote internet webpage source and process these in accordance with the soft key allocation techniques described above prior to passing the now modified display data out to the client device in a form matched to the capabilities of that client device and the specified user preferences of the user of that client device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Soft keys (6, 8) are allocated desired functions and associated labels (10, 12) in accordance with predetermined rules and in dependence upon variable mapping control data in order to match the display data to the display capabilities and available soft keys of a particular device. Candidates for allocation to soft keys can be given relative priorities for this allocation and preferred relative locations can be specified for individual or pairs of soft keys. User options can modify the way the soft keys are allocated to take account of left handed or right handed user of a device.

Description

ALLOCATION OF LABELS TO ASSOCIATED USER INPUT ELEMENTS
This invention relates to the allocation of labels to associated user input elements.
It is known to provide devices having a display with one or more user input elements having a function that varies dependent upon the state of the device and that is indicated by a corresponding label on a display of the device. As an example, mobile telephones often include several keys above which a label on the display indicates a particular function provided by that key given the current state of the mobile telephone. There is a desire to provide access to source data, such as internet webpages
(or other mark-up language document), via a wide diversity of device types.
Examples of such device types are mobile telephones and personal organisers.
Compared with the personal computers for which internet source material is usually developed, a characteristic of many of the new types of device with which it is desired to access this existing source material is that these devices have far more limited user input mechanisms, i.e. limited mouse functionality or keyboard functionality.
It is strongly desirable to be able to maximise the user input capabilities of a particular device accessing internet source material, such as by making full use of any soft keys available. However, a problem exists in that the soft key location, number and configuration of devices varies greatly. Accordingly, the burden of modifying the internet source data to produce specific versions adapted to each type of device is considerable.
Viewed from one aspect the present invention provides a method of generating display data for driving a display from source data, said display data including one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising the steps of: identifying within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating display data including labels associated with respective user input elements in accordance with said mapping.
The invention recognises that it is possible to generate display data that uses the soft key capabilities of a device without having to write special source data if instead predetermined rules are used to map the input label tags to appropriate user input elements in accordance with variable mapping control data. The mapping control data can specify the particular target device. Alternatively, the mapping data can specify different user options on a single target device type, such as options modifying the allocations of soft keys to suit left handed or right handed use. It will be appreciated that the labels to be associated with the user input elements could be text labels, icons, graphics or other entities for identifying the input elements to a user.
It will be appreciated that the user input elements could be physical keys or areas upon a touch sensitive display or other manually operable user inputs. Whilst the predetermined rules and the mapping control data could take many forms, it is preferred that the input label tags should have associated priorities controlling the order in which they are allocated to the available soft keys.
Further refinement in the way in which the soft keys are allocated is achieved in preferred embodiments in which the input label tags have associated preferred relative location data indicating one or a sequence of preferred locations of the soft key that should be allocated to that input label tag. In this way, a key and its label may be allocated to the most logical position e.g. a top button can be placed at the top of the display and a bottom button placed at the bottom of a display.
A common circumstance in many applications is that soft keys and labels are grouped into pairs. The relative location of the elements of these pairs is important for an intuitive use of the soft keys by a user. Accordingly, in preferred embodiments the predetermined rules seek to allocate the relative positions of the elements within a grouped pair in accordance with a sequence of preferences that tries to place the elements in the most logical and easy to operate positions for a particular user. Whilst the present invention may be used upon a wide variety of source data material (such as any mark-up language document), it is particularly useful in the context of displaying and interacting with internet webpages. Furthermore, the invention is particularly useful in the context of portable internet access devices such as wireless telephones.
Viewed from another aspect the present invention provides an apparatus for generating display data for driving a display from source data, said display data including one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising: identifying logic operable to identify within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping logic operable to map identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating logic operable to generate display data including labels associated with respective user input elements in accordance with said mapping. The invention also provides a computer program media bearing a computer program for controlling generation of display data in accordance with the above described techniques.
Embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings in which: Figure 1 illustrates a mobile telephone incorporating soft keys;
Figures 2A, 2B and 2C indicate a portable internet access device displaying labels for a plurality of soft keys in accordance with differing mapping control data;
Figures 3 and 4 illustrate a personal digital assistant displaying a webpage and respectively configured for a right handed user and a left handed user; Figure 5 is a simplified flow diagram illustrating the method of allocating labels to soft keys;
Figure 6 illustrates the sequence of preferred relative locations of elements within pairs of elements for two different types of pairs of elements; and
Figure 7 illustrates a data processing apparatus for implementing the techniques described in relation to Figures 1 to 6.
Figure 1 shows a mobile telephone 2 including a display 4. The mobile telephone 2 includes a first soft key 6 and a second soft key 8. The first soft key 6 has an associated label 10 and the second soft key 8 has an associated label 12. In this example the label is text, but it will be understood that the label could have a variety of other forms such as an icon, a graphic, etc.
The mobile telephone 2 is one that provides mobile internet access. Prior to display, the source data forming the internet webpage is searched for tags identifying soft keys and their labels. In this instance the number of soft keys available is very limited and so only the two highest priority soft keys can be allocated. In the example shown and for the particular webpage (or other mark-up language document) being displayed the highest priority soft keys correspond to the functions "Yes" and "No". For a right handed user who will typically operate the soft keys with their right thumb, it is most intuitive that the first key 6 should be allocated the function of "Yes" and the second key 8 should be allocated the function "No". For a left handed user who would operate the soft keys 6, 8 with their left thumb, then the labels 10, 12 may be reversed.
It will be appreciated that a different mobile telephone may have more available soft keys and so a greater number of labels may be displayed associated with the soft keys. Also, for a given mobile telephone, the allocation of the soft keys will vary between pages. Accordingly, on the page illustrated the highest priority labels correspond to "Yes" and "No", whereas on a different webpage whilst the "Yes" and "No" functions may be present, these may not be the highest priority items and accordingly will be superseded by other soft keys with their associated labels.
Figures 2 A, 2B and 2C all illustrate a mobile internet access device 14 having eight soft keys with associated labels. In these examples the user options have been set to specify a right handed user. Accordingly, the interface is made most intuitive and usable if the highest priority soft keys and labels are associated with the top right hand soft keys with priority decreasing upon moving downwards and leftwards. For a left handed user, then highest priority soft keys would be allocated in the top left hand corner with the priority decreasing upon moving downwards and rightwards.
In Figure 2A the input label tags within the source data indicate that the soft key pairs should be allocated in the priority order shown in the list of Figure 2A. The highest priority pair of soft keys is the Yes/No pair. This pair has associated relative location data indicating that it is most intuitive for a user for the Yes key to be placed horizontally to the right of the No key. Accordingly, these soft keys are respectively allocated to the top right hand key and the top left hand key. Similarly, the following pair of soft keys in the priority order are the Next/Previous soft keys that are also specified as preferably being horizontally relatively located with the Next key being allocated to the second highest key on the right hand side and the Previous key being allocated to the second highest key on the left hand side. The same is true of the OK and Cancel keys that are accordingly allocated to the third highest soft key on the right hand side and the third highest soft key on the left hand side. In the case of the Top and Bottom soft keys, these are fourth in the priority list. Accordingly, by the time that these soft keys are to be allocated, there are no longer available any vertically adjacent pair of soft keys to which they may be allocated. Accordingly, the next most preferably relative location of these soft keys is chosen that is one with the Top key horizontally to the right of the Bottom key.
Figure 2B illustrates display of the same webpage and soft keys except that the priority ordering has been altered. In this example the highest priority soft key pair is the Top key and the Bottom key and accordingly these are allocated to the right hand upper most two soft keys. The next soft key pair is the Yes and No soft keys. The top preference for the relative location of these keys is horizontally adjacent one another with the Yes key to the right of the No key for a right handed user. Accordingly, these are allocated to the third highest soft key on the right hand side and the third highest soft key on the left hand side respectively. The next highest priority soft key pair is the Next key and the Previous key. The only available horizontally pair of unallocated soft keys is not the lowermost pair of soft keys. Accordingly, the Next key is allocated to the lowermost right hand soft key and the Previous key is allocated to the lower most left hand soft key. The one remaining soft key pair to be allocated is the OK key and the Cancel key. Whilst the first preference for these keys is that the OK key should be to the right of the Cancel key, this is no longer a possibility and accordingly the second preference of the OK key being above the Cancel key is adopted.
Figure 2C illustrates a further example in which the first and second priority soft key pairs are allocated their preferred relative horizontal locations and the third highest priority soft key pair is allocated its preferred location of vertically adjacent soft keys. The final soft key pair of the Yes key and the No key has a first preference relative location of the Yes key being to the right of the No key, but this is no longer available and so the second preference of the Yes key being vertically above the No key is adopted.
Figures 3 and 4 illustrate a personal digital assistant 16 displaying the same internet webpage but in accordance with respective configurations for a right handed user and a left handed user. In this example there are two physical soft keys 18, 20 and four touch sensitive screen areas 22, 24, 26 and 28 that are allocated to soft keys. Further input label tags within the source data that are found once all of the available soft keys are allocated are in this case allocated to hypertext links 30.
All of the pairs of soft keys Yes/No OK/Cancel and Next/Previous that are allocated soft keys are ones in which the first order preference for a right handed user is with the first element horizontally to the right of the second element. When the user option data specifies a left handed user, then this is reversed with the first choice relative location being with the first element to the left of the second element. In the case of the Next and Previous soft keys, these are not allocated horizontally adjacent soft keys in either example and the vertical relative positions of these two soft keys are accordingly unchanged by the right hand and left hand user option.
Figure 5 illustrates a flow diagram of the technique of the present invention.
At step 32 a page of source data representing an internet webpage is fetched. This source data contains input label text specifying soft keys and soft key pairs to be allocated together with their respective labels, relative priorities and sequence of preferred relative positions.
At step 34, details are fetched of the target device upon which the source data is to be displayed. At step 36, user preferences, such as right handedness or left handedness are fetched. At step 38, the source page is parsed to identify the input label tags within the page.
At step 40 the number and ordering of the desired soft keys identified at step 38 is established.
At step 42 the soft keys are allocated to the available physical keys or touch screen areas of the target device in accordance with their relative priority ordering and the relative position preferences associated with each input label tag. At step 44 any remaining tags that have not been allocated to physical keys or touch screen areas are allocated to hypertext links that are inserted into the webpage to be displayed.
Figure 6 illustrates the sequence of relative position preferences for soft key pairs. In the upper example the soft key pair is one in which the highest preference is for one of the keys to be displayed vertically above the other key. The next preference is for the first key to be displayed to the right of the second key, the third preference is for the first key to be displayed above and to the right of the second key and the final preference is for the first key to be displayed above and to the left of the second key. If none of these preferences turns out to be available, then the keys can simply be allocated in turn to whatever soft keys, if any, remain.
The lower example of Figure 6 illustrates a soft key pairing which the highest preference is for the first key to be displayed horizontally to the right of the second key. The second preference is for the first key to be displayed vertically above the second key, the third preference is for the first key to be displayed above and to the right of the second key and the fourth preference is for the first key to be displayed below and to the right of the second key.
Both of the examples illustrated in Figure 6 are for a right handed user. In the case of a left handed user, the predetermined rule is modified such that the right hand positions and left hand positions in both of these examples, where applicable, are reversed.
Figure 7 illustrates a data processing apparatus, in this case the elements of a mobile telephone, for performing the above described techniques. The telephone includes a central processing unit 46, a read only memory 48, a random access memory 50, a wireless interface unit 52, a display driver 54 with associated display 56 and a user input unit 58 with associated physical soft keys 60 and touch sensitive areas 62.
In operation the central processing unit 46 executes a computer program stored within the read only memory 48 using the random access memory 50 as its working memory. Internet webpages received via the wireless interface unit 52 are processed to adapt them to the display capabilities and user option preferences of the particular device. This processing allocates soft keys identified by input label tags within the source data to available physical keys 60 and touch sensitive areas 62. It will be appreciated that in alternative embodiments, the processing to adapt the source data for a particular display 56 may instead be performed at the source server or a proxy server rather than at the client device. Accordingly, a mobile telephone could log into a proxy server and identify itself as a particular type of device. The user identifier and password could be used to access particular user preferences, such as indicating whether the user had specified right handed or left handed use. The proxy server via which the device had connected could then act to receive internet webpages from any other remote internet webpage source and process these in accordance with the soft key allocation techniques described above prior to passing the now modified display data out to the client device in a form matched to the capabilities of that client device and the specified user preferences of the user of that client device.
Whilst the example of Figure 7 indicates that the computer program for controlling the system in accordance with the present technique is stored in the read only memory 48, it will be appreciated that this computer program could be stored by many different media or indeed dynamically downloaded to the device via the medium of wireless communication.

Claims

1. A method of generating display data for driving a display from source data, said display data including, one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising the steps of: identifying within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating display data including labels associated with respective user input elements in accordance with said mapping.
2. A method as claimed in claim 1, wherein said user input element is a key having a variable function indicated by an associated label upon said display.
3. A method as claimed in claim 1, wherein said display is a touch sensitive display and said user input element is an area of said touch sensitive display having a variable function indicated by and associated label upon said touch sensitive display.
4. A method as claimed in any one of claims 1, 2 and 3, wherein said display is part of one of a plurality of different types of device and said variable mapping control data includes device specifying data indicating upon which type of device said display data is to be displayed.
5. A method as claimed in claim 4, wherein said different types of device have differing user input elements.
6. A method as claimed in any one of claims 4 and 5, wherein said different types of device have different display capabilities.
7. A method as claimed in any one of the preceding claims, wherein said variable mapping control data includes user specified option data.
8. A method as claimed in claim 7, wherein said user specified option data indicates whether display data should be adapted for a right handed user or a left handed user.
9. A method as claimed in any one of the preceding claims, wherein said one or more input label tags each include priority data indicating a relative display priority.
10. A method as claimed in claim 9, wherein one of said predetermined rules maps said input label tags to available user input elements in accordance with said priority data.
11. A method as claimed in claim in any one of the preceding claims, wherein said one or more input label tags each include preferred relative display location data indicating a preferred relative display location of an associated user input element to be mapped to said input label tag.
12. A method as claimed in claim 11, wherein one of said predetermined rules maps said input label tags to available user input elements in accordance with said preferred relative display location data.
13. A method as claimed in claims 11 and 12, wherein said preferred relative display location data indicates an ordered sequence of preferred relative display locations and said one of said predetermined rules maps an input label tag to a most preferred available user input element within said ordered sequence.
14. A method as claimed in claims 9 and 13, wherein relative display location preferences of an input label tag having a higher relative priority are satisfied from those available user input elements before those of an input label tag having a lower relative priority.
15. A method as claimed in any one of the preceding claims, wherein labels and associated user input elements are grouped in pairs.
16. A method as claimed in claims 11 and 15, wherein said preferred relative display location indicates a preferred relative location of a first element of a pair with respect to a second element of a pair.
17. A method as claimed in claim 16, wherein a preferred relative location of said first element is above said second element on said display.
18. A method as claimed in claims 8, 13 and 17, wherein at least a first portion of said ordered sequence of preferred relative locations for a right handed user is: said first element substantially directly above said second element; said first element substantially directly right of said second element; said first element above and to the right of said second element; and said first element above and to the left of said second element.
19. A method as claimed in claims 8, 13 and 17, wherein at least a first portion of said ordered sequence of preferred relative locations for a left handed user is: said first element substantially directly above said second element; said first element substantially directly left of said second element; said first element above and to the left of said second element; and said first element above and to the right of said second element.
20. A method as claimed in claim 14, wherein a preferred relative location of a first element is substantially to the right of said second element on said display.
21. A method as claimed in claims 8, 13 and 20, wherein at least a first portion of said ordered sequence of preferred relative locations for a right handed user is: said first element substantially directly right said second element; said first element substantially directly above of said second element; said first element above and to the right of said second element; and said first element below and to the right of said second element.
22. A method as claimed in claims 8, 13 and 20, wherein at least a first portion of said ordered sequence of preferred relative locations for a left handed user is: said first element substantially directly left said second element; said first element substantially directly above of said second element; said first element above and to the left of said second element; and said first element below and to the left of said second element.
23. A method as claimed in any one of the preceding claims, wherein said source data is a mark up language data file.
24. A method as claimed in any one of the preceding claims, wherein said display data represents an internet webpage.
25. A method as claimed in claim 24, wherein any input data tags for which user input elements are not available are associated with hypertext links within said internet webpage.
26. A method as claimed in claim 4, wherein said plurality of types of device comprise a plurality of types of portable internet access devices.
27. A method as claimed in claim 26, wherein said plurality of types of portable internet access devices comprise a plurality of types wireless telephones having internet access capability.
28. An apparatus for generating display data for driving a display from source data, said display data including one or more labels associated with respective user input elements, said one or more labels being changeable to reflect changeable functions associated with respective user input elements, said method comprising: identifying logic operable to identify within said source data one or more input label tags corresponding to one or more labels and associated user input elements; mapping logic operable to map identified input label tags to available user input elements of said display device in accordance with predetermined rules and in dependence variable mapping control data; and generating logic operable to generate display data including labels associated with respective user input elements in accordance with said mapping.
29. A computer program media bearing a computer program for controlling a computer to perform a method as claimed in any of claims 1 to 27.
PCT/GB2001/002889 2000-08-07 2001-06-29 Allocation of labels to associated user input elements WO2002013001A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0019363A GB2365734A (en) 2000-08-07 2000-08-07 Allocation of labels to associated user input elements
GB0019363.1 2000-08-07

Publications (2)

Publication Number Publication Date
WO2002013001A2 true WO2002013001A2 (en) 2002-02-14
WO2002013001A3 WO2002013001A3 (en) 2002-05-30

Family

ID=9897140

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2001/002889 WO2002013001A2 (en) 2000-08-07 2001-06-29 Allocation of labels to associated user input elements

Country Status (2)

Country Link
GB (1) GB2365734A (en)
WO (1) WO2002013001A2 (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6564283B1 (en) * 1999-05-20 2003-05-13 Samsung Electronics Co., Ltd. Data processing system for expanded addresses
GB2385692A (en) * 2002-03-13 2003-08-27 Besdi Pty Ltd Device interface and text input system
EP1431868A2 (en) * 2002-12-17 2004-06-23 Nec Corporation Portable terminal device with pointing device
EP1496677A1 (en) * 2003-07-08 2005-01-12 Sony Ericsson Mobile Communications AB Communication apparatus having programmable soft keys and method of programming such soft keys
WO2005006162A2 (en) * 2003-07-08 2005-01-20 Sony Ericsson Mobile Communications Ab Communication apparatus having programmable soft keys and method of programming soft keys
WO2006070228A3 (en) * 2004-12-30 2006-09-28 Nokia Corp Application specific key buttons in a portable device
DE102006046496A1 (en) * 2006-09-29 2008-04-03 Bayerische Motoren Werke Ag Information outputting device for use in motor vehicle, has control unit actuated for producing control commands to provide interaction between operator and device, where control commands are partially diversified based on service data
CN100440135C (en) * 2002-11-26 2008-12-03 摩托罗拉公司(在特拉华州注册的公司) Subscriber device with adaptable user interface and method thereof
NL1033959C2 (en) * 2007-06-11 2008-12-12 Ten Holter Const B V Electrical system controlling and managing system for e.g. building, has communication modules connected or integrated with control modules, and alert screen displaying horizontal and vertical rectangular, round or square signs
EP1467539A3 (en) * 2003-04-09 2009-11-11 Nec Corporation Mobile terminal
WO2010143025A1 (en) * 2009-06-09 2010-12-16 Sony Ericsson Mobile Communications Ab Distinguishing right-hand input and left-hand input based on finger recognition
US8370393B2 (en) 2005-08-12 2013-02-05 Kannuu Pty Ltd. Process and apparatus for selecting an item from a database
CN104216640A (en) * 2013-05-29 2014-12-17 联想(北京)有限公司 Physical button position prompting method and electronic device
US9697264B2 (en) 2002-08-20 2017-07-04 Kannuu Pty. Ltd. Process and apparatus for selecting an item from a database
US10073587B2 (en) 2013-05-29 2018-09-11 Beijing Lenovo Software Ltd. Information prompt method and electronic apparatus
JP2020024755A (en) * 2017-03-06 2020-02-13 京セラ株式会社 Electronic apparatus, control method, and control program

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE536693T1 (en) 2006-01-04 2011-12-15 Alcatel Lucent REMOTE CONTROLLED PROGRAMMABLE BUTTONS

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0872994A1 (en) * 1997-04-18 1998-10-21 Ascom Business Systems Ag Apparatus with a touch-sensitive display screen
EP1004957A1 (en) * 1998-03-05 2000-05-31 Mitsubishi Denki Kabushiki Kaisha Portable terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2332293A (en) * 1997-12-11 1999-06-16 British Telecomm An Input Device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0872994A1 (en) * 1997-04-18 1998-10-21 Ascom Business Systems Ag Apparatus with a touch-sensitive display screen
EP1004957A1 (en) * 1998-03-05 2000-05-31 Mitsubishi Denki Kabushiki Kaisha Portable terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"CUSTOMIZABLE SOFTWARE KEYBOARD" IBM TECHNICAL DISCLOSURE BULLETIN, IBM CORP. NEW YORK, US, vol. 41, no. 1, 1998, page 277 XP000772106 ISSN: 0018-8689 *

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6564283B1 (en) * 1999-05-20 2003-05-13 Samsung Electronics Co., Ltd. Data processing system for expanded addresses
GB2385692A (en) * 2002-03-13 2003-08-27 Besdi Pty Ltd Device interface and text input system
GB2385692B (en) * 2002-03-13 2004-04-21 Besdi Pty Ltd A mobile telephone
US9729701B2 (en) 2002-03-13 2017-08-08 Kannuu Pty Ltd. Device interface
US9697264B2 (en) 2002-08-20 2017-07-04 Kannuu Pty. Ltd. Process and apparatus for selecting an item from a database
CN100440135C (en) * 2002-11-26 2008-12-03 摩托罗拉公司(在特拉华州注册的公司) Subscriber device with adaptable user interface and method thereof
EP1431868A3 (en) * 2002-12-17 2008-09-24 Nec Corporation Portable terminal device with pointing device
US7710401B2 (en) 2002-12-17 2010-05-04 Nec Corporation Portable terminal device with pointing device
EP1431868A2 (en) * 2002-12-17 2004-06-23 Nec Corporation Portable terminal device with pointing device
US7907978B2 (en) 2003-04-09 2011-03-15 Nec Corporation Mobile terminal
EP1467539A3 (en) * 2003-04-09 2009-11-11 Nec Corporation Mobile terminal
WO2005006162A3 (en) * 2003-07-08 2005-04-28 Sony Ericsson Mobile Comm Ab Communication apparatus having programmable soft keys and method of programming soft keys
WO2005006162A2 (en) * 2003-07-08 2005-01-20 Sony Ericsson Mobile Communications Ab Communication apparatus having programmable soft keys and method of programming soft keys
EP1496677A1 (en) * 2003-07-08 2005-01-12 Sony Ericsson Mobile Communications AB Communication apparatus having programmable soft keys and method of programming such soft keys
WO2006070228A3 (en) * 2004-12-30 2006-09-28 Nokia Corp Application specific key buttons in a portable device
US7461350B2 (en) 2004-12-30 2008-12-02 Nokia Corporation Application specific key buttons in a portable device
US8676852B2 (en) 2005-08-12 2014-03-18 Kannuu Pty Ltd Process and apparatus for selecting an item from a database
US8375058B2 (en) 2005-08-12 2013-02-12 Kannuu Pty Ltd Process and apparatus for selecting an item from a database
US8996579B2 (en) 2005-08-12 2015-03-31 Kannuu Pty Ltd Process and apparatus for selecting an item from a database
US8370393B2 (en) 2005-08-12 2013-02-05 Kannuu Pty Ltd. Process and apparatus for selecting an item from a database
US9436354B2 (en) 2005-08-12 2016-09-06 Kannuu Pty Ltd Process and apparatus for selecting an item from a database
US9836489B2 (en) 2005-08-12 2017-12-05 Kannuu Pty Ltd Process and apparatus for selecting an item from a database
US11573939B2 (en) 2005-08-12 2023-02-07 Kannuu Pty Ltd. Process and apparatus for selecting an item from a database
DE102006046496A1 (en) * 2006-09-29 2008-04-03 Bayerische Motoren Werke Ag Information outputting device for use in motor vehicle, has control unit actuated for producing control commands to provide interaction between operator and device, where control commands are partially diversified based on service data
US11200252B2 (en) 2007-01-03 2021-12-14 Kannuu Pty Ltd. Process and apparatus for selecting an item from a database
NL1033959C2 (en) * 2007-06-11 2008-12-12 Ten Holter Const B V Electrical system controlling and managing system for e.g. building, has communication modules connected or integrated with control modules, and alert screen displaying horizontal and vertical rectangular, round or square signs
WO2010143025A1 (en) * 2009-06-09 2010-12-16 Sony Ericsson Mobile Communications Ab Distinguishing right-hand input and left-hand input based on finger recognition
CN104216640A (en) * 2013-05-29 2014-12-17 联想(北京)有限公司 Physical button position prompting method and electronic device
CN104216640B (en) * 2013-05-29 2019-12-24 联想(北京)有限公司 Physical key position prompting method and electronic equipment
US10073587B2 (en) 2013-05-29 2018-09-11 Beijing Lenovo Software Ltd. Information prompt method and electronic apparatus
JP2020024755A (en) * 2017-03-06 2020-02-13 京セラ株式会社 Electronic apparatus, control method, and control program

Also Published As

Publication number Publication date
WO2002013001A3 (en) 2002-05-30
GB0019363D0 (en) 2000-09-27
GB2365734A (en) 2002-02-20

Similar Documents

Publication Publication Date Title
US11281360B2 (en) Display management for native user experiences
US6462760B1 (en) User interfaces, methods, and computer program products that can conserve space on a computer display screen by associating an icon with a plurality of operations
JP4750714B2 (en) Apparatus, method, and computer program for providing menu expansion and ordering functions
US9910582B2 (en) Techniques for navigating information
US7571393B2 (en) Method for navigation between elements on a page of content in a handheld device
US10503255B2 (en) Haptic feedback assisted text manipulation
US9021398B2 (en) Providing accessibility features on context based radial menus
WO2002013001A2 (en) Allocation of labels to associated user input elements
US7506259B1 (en) System and method for dynamic mapping of abstract user interface to a mobile device at run time
US8949858B2 (en) Augmenting user interface elements with information
US20110072370A1 (en) User interface modifier
KR20100025011A (en) Method, apparatus and computer program product for facilitating data entry via a touchscreen
JP5254399B2 (en) Display device, user interface method and program
CN102918490A (en) Interacting with remote applications displayed within a virtual desktop of a tablet computing device
US20100235750A1 (en) System, method and program product for a graphical interface
US20080163065A1 (en) Using a light source to indicate navigation spots on a web page
JP6020191B2 (en) Display control apparatus and program
CN103544028A (en) Information processing apparatus and information processing method
JP2012064207A (en) Host device and content display method of the same
US20090177987A1 (en) Efficient display of objects of interest to a user through a graphical user interface
CN111602109B (en) Information providing apparatus, information providing method, and non-transitory recording medium
CN104321732A (en) User interface device, search method, and program
US8959444B2 (en) Presenting a navigation order of shapes
EP3472728A1 (en) Deconstructing and rendering of web page into native application experience
US7472168B2 (en) Method for dynamically assigning and displaying character shortcuts on a computing device display

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP US

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): JP US

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP