EP2452251B1

EP2452251B1 - User friendly entry of text items

Info

Publication number: EP2452251B1
Application number: EP10740319.8A
Authority: EP
Inventors: Dzmitry Viktorovich Aliakseyeu; Igor Berezhnyy
Original assignee: Koninklijke Philips NV
Current assignee: Koninklijke Philips NV
Priority date: 2009-07-10
Filing date: 2010-07-01
Publication date: 2018-09-19
Anticipated expiration: 2030-07-01
Also published as: RU2562364C2; CN102549529A; JP5906185B2; KR101658195B1; CN105807950A; US20120105328A1; RU2012104670A; US8766918B2; CN105807950B; KR20120039005A; WO2011004292A1; EP2452251A1; JP2012533107A

Description

BACKGROUND OF THE INVENTION

TECHNICAL FIELD

The present invention relates to a system and method for entering text items, such as characters.

DESCRIPTION OF RELATED ART

The rapid increase in the number and capacity of broadband Internet connections has lead to the introduction of new Internet-based services. One of these novel services is Internet Protocol Television (IPTV). The introduction of IPTV reduced the gap between TV and personal computers, since many features that were only available on a personal computer became accessible on a TV. The question is, however, how to make these new features easily accessible to users. Conventional remote controls fail to provide an easy and enjoyable interaction since they are not designed to support these new features, while on the other side a keyboard and mouse that can support these new features are not desired in the living room. One of the new features is the ability to search media content provided by service provider or search for particular program in a program guide. This search is often done by means of a text entry. As, the conventional remote control is not well suited for text entry, currently the most often used method for text entry is by using a screen keyboard operated by arrow keys.
Over the recent years, devices, in particular mobile phones have become available using predictive text entry methods. Such predictive text entry methods attempt to predict which letter mapped to a particular key of the keypad is most likely to be selected when the key is pressed during text entry. In this manner, the number of key taps required to enter non-numeric text is reduced compared to conventional multi-tap text entry.
Furthermore, hand-held communication devices have become available with small form factors or aesthetically pleasing shapes. In such hand-held communication devices, the provision of a conventional numeric keypad is often either impossible or undesirable. Consequently, the hand-held communication devices typically rely on menu driven displays and voice-recognition technologies such as voice-dialing and voice-entered commands in combination with a simple navigation key assembly instead of a full numeric keypad. However, in such devices, text messaging, if supported, requires extensive scrolling through a fixed character menu, and repeated keystrokes to select characters for a text message being composed.
US 2005/041011 A1 discloses a method for entering text at a user interface for an electronic device, and a text entry user interface for an electronic device. The text entry user interface comprises a display for displaying characters and entered text, an input device for issuing commands to browse and select characters, and a processing unit for controlling the operation of the user interface. The processing unit is further configured to generate, for browsing, a character subset made up of characters to be browsed, the character subset including the characters of a character set from among which, according to an inference logic configured into the processing unit, the next character for the text is most probably selected, and display the character subset on the display for browsing the characters and for selecting the next character by using the input device.
US 7,218,249 B2 discloses a hand-held communication device providing navigation key-based predictive text entry. It includes a display disposed for displaying characters selectable for entry in a character position of a text string being entered and a navigation key assembly for scrolling through and selecting from the characters displayed on the display. The characters displayed during text entry are arranged according to the probability of selection of each character for entry in the character position so that the character with the highest probability of selection is selected with a single input from the navigation key assembly.
However, with these devices it will relatively often happen that the user does not wish to select the character with the highest probability but another character. It will then be necessary to scroll to this other character in order to enter it.
US 2004/066405 discloses an input device into which characters from a character set can be input, especially one-handedly, and a method for using the input device. The input device includes a display, at least one scrolling device, and at least one key, with at least one part of the character set being displayed on the screen by line and column. The method is characterized in that a character is input by means of the scrolling device which is used to preselect at least one part of a column, and by means of the at least one key which is used to select a character from a line of the preselected column.

SUMMARY OF THE INVENTION

It would be advantageous to provide a system and method enabling easy entry of text items, such as characters, without overloading a control device, such as a remote control or a handheld communication device with multiple keys for this purpose.
To better address this concern, in a first aspect of the invention a system for entering text items by a user is presented as defined in claim 1.
So, a plurality of items with a high likelihood of being entered next is displayed, preferably two or three. Any one of these items may be directly entered by the user without further navigation by means of a single input, such as a single key press, a single click or a single movement. So, the chance that a user can enter the desired item without further navigation is relatively high. As a result, items such as characters may be entered in a user friendly way.
In case that the user wishes to enter another item than the proposed items, he may navigate through the displayed items to the other item and enter the other item.
According to the invention, the display controller is configured for causing the display of the items that may be entered in an ordered list, for example consisting of pairs of items or sets of three items placed in a column through which the user can navigate. In case that the items are letters, the list may be alphabetically ordered.
According to the invention, the display controller is configured for causing the display of the proposed items at the location in the list of the previously entered item and causing the display of the other items at their initial position. In this way, the list presented to the user is easily comprehensible. The user easily finds and selects an item other than the proposed items.
According to a further embodiment, the input means comprises a continuous control, such as a rotary input and/or a sliding input for enabling the navigation through the displayed items. A continuous control, contrary to discrete controls such as arrow keys, enables user friendly navigation through the items that may be selected.
Preferably, the continuous control is one dimensional. This enables user friendly navigation in case that the items that may be entered are displayed as a list.
The rotary input may be a scroll wheel. Scroll wheels require few changes to the hardware of electronic devices wherein the system is to be used and take a small space thereon. Furthermore, they enable user friendly navigation through and entry of items.
The input means may comprise a plurality of keys, each one of the keys enabling the entry of one of the proposed items. Alternatively, the scroll wheel is a tilting wheel enabling clicking of the wheel in different ways, wherein each way of clicking results in the entry of one of the proposed items. According to another alternative embodiment, the rotary input is a touch wheel, enabling the navigation through the items by moving over the touch wheel and entry of each of the proposed items by a corresponding stroke on the touch wheel. All three embodiments enable user friendly selection of any of a plurality of proposed items.
The system may be implemented in any electronic device, for example a remote control or a handheld communication device. It combines language aware word prediction with a specific user interaction and allows quickly entering short text messages or search keywords in any given language.
According to a further aspect of the invention method is provided for entering text items by a user as defined in claim 11.
Preferably, the method according to the invention is implemented by means of a computer program.
The computer program may be embodied on a computer readable medium or a carrier medium may carry the computer program.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be better understood and its numerous objects and advantages will become more apparent to those skilled in the art by reference to the following drawings, in conjunction with the accompanying specification, in which:

Figure 1 shows a block diagram of a remote control comprising a system according to an exemplary embodiment of the present invention.
Figure 2 shows an example of a scroll wheel that may be used in the present invention.
Figure 3 shows an example of a touch wheel that may be used in the present invention.
Figure 4 shows the display of an alphabetical list of characters according to an exemplary embodiment of the present invention.
Figure 5 shows the list of figure 4 including the most likely characters to be entered next at the cursor position.
Figure 6 shows how to manipulate a scroll wheel and a touch wheel to navigate through the list of characters.
Figure 7 shows how to manipulate a scroll wheel and a touch wheel to enter a character.
Figure 8 shows the display of an alphabetical list of characters according to another exemplary embodiment of the present invention.
Figure 9 shows the list of figure 8 including the most likely characters to be entered next at the cursor position.

Throughout the figures like reference numerals refer to like elements.

DETAILED DESCRIPTION OF THE PRESENT INVENTION

Figure 1 shows a block diagram of a remote control 10 comprising a system for predictive text entry according to an embodiment of the present invention. It comprises a processor 20 with associated memory 30, a display 40, an IR transmitter 50 for transmitting control commands to an appliance and input means 60.
The memory 30 is loaded with a first software module 70. When loaded to the processor 20, this software module provides the input control functionality, i.e. it determines the meaning of commands received via the input means 60. The memory 30 is furthermore loaded with a second software module 80. When loaded to the processor 20, this software module provides the display control functionality, i.e. it controls the information that is displayed on the display 40. The memory 30 is furthermore loaded with a third software module 90, which when loaded to the processor, provides prediction engine functionality for predicting the likelihood of characters to be entered next based on a previously entered text string. The memory comprises also software for providing further functionality of the remote control 10, such as generating the control commands to be sent to the appliances, which are controlled by the remote control 10, etc. This well known functionality is not relevant for the present invention and will therefore not be further described here.
The input means 60 comprise a tilting scroll wheel 110 as depicted in figure 2 or a touch wheel 115 as depicted in figure 3 for navigating through the displayed items. The scroll wheel may be a tilting wheel as described at http://www.microsoft.com/hardware/mouseandkeyboard/features/tiltwheel.mspx. Tilting wheel technology supports three-way clicking, enabling the user to click the scroll wheel by pressing down, left or right. The touch wheel 115 is similar to the one used in the iPod® product. It has a touch sensitive surface enabling the user to scroll by moving his finger circularly over the wheel and to click by making a left or right movement over the wheel. It may also be a "virtual scroll wheel" displayed on a touch screen.
According to an embodiment of the invention, the items are single characters placed in pairs in an alphabetically ordered column 100, as shown in figure 4. The user can scroll through the list by rotating the scroll wheel 110 or moving his finger circularly over the touch wheel as shown in figure 6, thereby moving cursor 120 through the list. To select (enter) one of the two characters of a pair under the cursor 120 the user clicks the scroll wheel to the left or right or makes a right click or left click on the touch screen by means of a right or left movement, as shown in figure 7. When the initial character is selected (in the example of figure 4 this is the letter [D]) this letter is added to a text string 130 and the original column of characters is expanded in such a way that the most probable characters to be selected next are placed under the cursor 120 as proposed characters 140 in the alphabetical ordered list, as shown in figure 5. Accordingly, they can be directly selected (entered) by the user without further navigating (scrolling) by means of either a left click or a right click. As shown in the example of figure 5, if the user enters [D] the column 100 of characters expands placing the two characters, which are most likely to be selected next, in this case [A], which is the most likely character and [I], which is the next most likely character under the cursor 120. In the example of figure 5, the most likely character is displayed on the right and the next most likely character on the left but of course this may also be the other way round. Also, the most likely characters may be displayed in alphabetical order, e.g. the first letter on the left and the second letter on the right. The remaining letters are displayed in alphabetical order at their initial position in the list.
Each of the proposed characters 140 can be directly selected (entered) by the user without scrolling through the list by means of either a left click or a right click. In case that the user wishes to select another character than the proposed characters, he simply scrolls to the desired character and enters it, either by a right or a left click.
In order to determine the probability of characters being entered next, a prediction engine 90 known per se is used. Some probability based text auto-completion algorithms that may be used by the prediction engine are described at http://www.customtyping.com/tutorials/kb/wp_auto_complete.htm. The probability depends on the dictionary that is used. In case of a remote control, an interesting application for the user is to search an electronic program guide. In this case, the dictionary is defined by the finite amount of words present in a program guide.
Instead of being a single character, some of the items may be small sets of characters (e.g. two). For example, if a user enters [B], the items [Y] and [AR] may be placed under the cursor as proposed items, the first item [Y] corresponding to a single character and the second item [AR] corresponding to a set of two characters.
According to an alternative embodiment, a column 150 consisting of single characters per row is initially displayed as shown in figure 8. In the example, the user scrolls to the letter [B] by rotating the scroll wheel and enters this letter by pressing the wheel down. A this time, the three most likely characters to be entered next, in this example [Y], [O] and [E] are placed under the cursor 120 as proposed characters 140, as shown in figure 9. The user can select any of the proposed characters by a left, a right or a "middle" click.
The functionality described with reference to the figures 4-9 is implemented by means of the first software module 70, second software module 80 and third software module 90 in combination.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.
In this regard it is to be noted that the component of the system according to the invention may be spread over multiple devices. For example, the display 40 may not be located in the remote control but it may be the screen of the corresponding television set. Also, it is not necessary to implement the predictive engine 90 locally in the remote control. It may be implemented in another device.
The predictive text entry system according to the invention can be applied to other electronic devices than remote controls for television, for example handheld (mobile) communication devices, GPS navigation devices, car audio systems, etc.
Instead of using scroll wheel with tilt wheel technology, a scroll wheel similar to the ones used in a computer mouse may be used in the system. Such a scroll wheel comprises two discrete keys. One of those may serve for the left click and the other one for the right click. The "middle" click may be performed by pressing the scroll wheel down. Alternatively, a "clickable" slider may be used, enabling the navigation through the list of characters by sliding and selecting characters by clicking.
Furthermore, instead of displaying the characters in an alphabetically ordered list, the characters may be displayed according to their probability of being selected next. So, the proposed characters, which are the characters with the highest likelihood to be entered next, are displayed at a certain location in the list and the rest of the list of characters is ordered according to the probability. The characters with a high probability to be selected next are displayed in the list close to the proposed characters and the characters with a low probability to be selected are displayed far from the proposed characters.
Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.
The present invention can be resumed as follows: a system for predictive text entry wherein, initially the items that may be entered by the user are displayed. The user can navigate through these items and enter one of them to a text string. A predictive text entry algorithm is used, which depending on the previously entered item, determines items, which are likely to be entered next. A plurality of these items, for example two or three, is displayed. The user can then select any one of these items without navigating through the displayed items.

Claims

System for entering text items by a user comprising:
- a computer (20);

- a display (40);

- input means (60);

- a display controller (80) for controlling the display of items that may be entered and

- an input controller (70) for enabling the movement of a cursor (120) through the displayed items
wherein the display controller (80) is configured for causing the display of a plurality of items, which have been determined likely to be entered next by a prediction engine (90), as proposed items (140), and for causing the display of an ordered list (100) comprising further items that may be entered, the list also comprising the cursor (120), characterized in that
the input means comprises means that enable direct selection of multiple items, and
the input controller (70) is configured, when displaying the proposed items (140), to insert the proposed items (140) in the ordered list by placing the proposed items (140) under the cursor,
thereby enabling the user
- to directly enter any one of the proposed items (140) by the input means (60) without further moving the cursor (120) through the displayed items and

- to enter any one of the further items after moving the cursor to the location of the one of the further items in the ordered list.
System according to claim 1 wherein the input controller (70) is configured for enabling the user to enter one of the further items by moving the cursor (120) through the displayed items to the one of the further item and entering the one of the further item.
System according to claim 1 wherein the items are letters and the list is alphabetically ordered.
System according to claim 1 wherein the input means (60) comprise a rotary input and/or a sliding input (110,115) for enabling the cursor movement through the displayed items.
System according to claim 4 wherein the rotary input or sliding input (110,115) is one dimensional.
System according to claim 4 wherein the rotary input is a scroll wheel (110).
System according to claim 6 wherein the scroll wheel is a tilting wheel enabling clicking of the wheel in different ways, wherein each way of clicking results in the entry of one of the proposed items.
System according to claim 4 wherein the rotary input is a touch wheel (115), enabling the navigation through the items by moving over the touch wheel and entry of each of the proposed items by a corresponding stroke on the touch wheel.
System according to claim 1 wherein the selection means of the input means (60) comprises a plurality of keys, each one of the keys enabling the entry of one of the proposed items.
Remote control (10) or handheld communication device comprising a system according to claim 1.
Method for entering text items by a user comprising the steps of:
- controlling, by a display controller (80), the display of items that may be entered,

- enabling, by an input controller (70), movement of a cursor (120) through the displayed items and entering any one of them, by means of input means (60),

- causing, by the display controller (80), the display of a plurality of items, which have been determined likely to be entered next, by a prediction engine (90), as proposed items (140),
and the display of an ordered list (100) comprising further items that may be entered, the list also comprising the cursor (120),
characterized by the following steps:
- causing, by the display controller (80), when displaying the proposed items (140), the insertion of the proposed items (140) into the ordered list by placing the proposed items (140) under the cursor (120), thereby

- enabling the user to directly enter any one of the proposed items (140) by input means (60) that enable direct selection of multiple items without further moving the cursor (120) through the displayed items, and

- enabling the user to enter any one of the further items after moving the cursor to the location of the one of the further items in the ordered list.
A computer program comprising computer program code means adapted to perform the steps of claim 11, when said program is run on a computer (20) comprised in a system according claim 1.