FR2751442A1 - Pocket-sized PDA man-machine interface for controlling portable telephone - Google Patents

Abstract

The man-machine interface comprises a keyboard with a reduced number of alphanumeric keys and a tactile screen allowing the use and recognition of alphanumeric characters which are not recorded on the keyboard. There is also a display screen. The tactile screen is used for contextual commands which vary in detail according to the mode of operation of the device at a given time. The device has a control system, operable by the keyboard, allowing display of non-keyboard characters on the tactile screen and standard alphanumeric characters on the display screen. Either type of character may be finally selected for communication with the device.

Description

HUMAN INTERFACE DEVICE / POCKET MACHINE
The invention relates to a handheld human / machine interface device intended to be used by a very wide audience, particularly in the field of telematics or in the field of screen radiotelephones for example.

A large number of handheld or portable computing devices are currently available on the market. The small man-machine interfaces used so far, not only for text input and processing but also for interactive navigation, that is for the selection of objects on the screen, are including pocket microcomputers or optical pen and touch screen interfaces still referred to as "Personal Digital
Assistants "(PDA) in Anglo-Saxon literature.

 Pocket PCs include a conventional alphanumeric keyboard but very small dimensions imposing additional constraints on the user. Indeed, given the small size of the keyboard, the input of a text is made difficult and unreliable since the user must be very careful to avoid typing 'on two contiguous keys simultaneously. In addition, this kind of pocket microcomputer does not include a device type "mouse", but specific keys on the keyboard to move the cursor on the screen and select objects.

However, these specific keys are much less effective than a mouse and do not allow a quick selection of objects.

 Optical pencil interfaces also have several disadvantages. The software of recognition of the writing is in particular very insufficient to date and make the seizure of the texts unreliable. The writing itself, by means of an optical pencil, is not easy and the designation of an object on the screen is not very reliable especially when it is about a small object cut. In addition, when a user writes a word, it immediately disappears and reappears on the screen in typographical form. This incessant change of the screen display is very unpleasant and causes great fatigue of the eyes of the user. Finally, these interfaces require manipulation of two tools, that is to say a touch screen and an optical pencil, instead of one.

 Moreover, the analog displacement slider members used in portable computers, such as small balls still called "track ball" in English literature, for example, are not compatible with devices made in pocket format. Their efficiency is furthermore considerably less than that of "mouse" type peripherals.

 The present invention makes it possible to solve all these drawbacks since it proposes a handheld human / machine interface device whose keyboard, of reduced size, comprises on the one hand a number of keys smaller than the number of keys of conventional keyboards, and allows a on the other hand to position a cursor and select objects on the screen.

This device is characterized in that it comprises:
- a keyboard with a reduced number of alphanumeric keys,
a touch screen, associated with the keyboard, allowing the input of characters not inscribed on the keyboard and the activation of contextual commands,
- a display screen,
- Piloting means, actuated by the keyboard keys and / or touchscreen keys, both to display on the touch screen alphanumeric characters not listed on the keyboard, and to display on the display screen for alphanumeric characters written on the keyboard, and
display screen control means, operable by the keys of the keyboard and / or by the keys of the touch screen, making it possible to trigger the display on the display screen of an alphanumeric character written on the display screen; the keyboard or on the touch screen.

 A contextual command is defined as a key capable of performing a function defined temporarily according to the context. The context also corresponds to the various modes of use, such as word processing, selection of objects or navigation in a text for example.

 The human / machine interface device according to the invention further comprises associating means for controlling the display on the display screen of a selection window and for corresponding, by analogy of position, with each alphanumeric key of the keyboard, a homologous zone of the selection window, and in that these means can be actuated by the keys of the touch screen and / or by the keys of the keyboard.

 These association means also make it possible to divide the selection window into several selection sub-windows each corresponding, by position analogy, to one or more alphanumeric keys of the keyboard.

 According to another embodiment of the device according to the invention, the association means further enable the selection window to be tiled in such a way that each selection block contains one and only one object that can be selected. and one or more peer areas, each associated with a key on the keyboard.

 According to another embodiment of the device according to the invention, the control means of the display screen can also be actuated simultaneously by two contiguous keys of the keyboard so as to trigger the display, on the display screen , an alphanumeric character corresponding to a character inscribed in the space between said two contiguous keys.

 On the other hand, the man / machine interface according to the invention further comprises a non-volatile program memory capable of sequentially managing the information transmitted to it. A list of characters not shown on the keyboard, but similar graphically and / or phonetically and / or semantically to those that are written on the keyboard, is stored in said non-volatile memory.

 Finally, the device according to the invention is advantageously made so that the keyboard, the touch screen and the display screen are assembled on one side and the other side comprises a second screen of display, all over its surface, framed by a tactile outline.

 The fact of making such a device with a keyboard having a reduced number of keys, that is to say with a keyboard having keys spaced apart from each other than in conventional keyboards made to the same dimensions, makes it possible to reduce the number of typing errors that may occur and therefore improve the quality of text entry.

 The keyboard and the associated touch screen form a "keyboard block". The touch screen allows, when a keyboard key has been hit, to display one or more characters not shown on the keyboard but defined as being similar to this key.

To enter one of these similar characters, then simply press the touch screen at the location of the character to enter.

 Moreover, the device according to the invention allows the use of all the keys of the keyboard for the selection of objects on the screen or for the positioning of a cursor. This keyboard selection is as fast and efficient as with a "mouse" type computer device.

Other features and advantages of the invention will appear on reading the description given by way of illustrative and nonlimiting example with reference to the appended figures in which:
FIG. 1 represents a view from above of a device according to the invention,
FIG. 2 represents a schematic diagram of a device according to the invention,
FIGS. 3A to 3F illustrate examples of what appears on the screen during an object selection by the keyboard,
FIG. 4 illustrates another example of object selection by the keyboard,
FIGS. 5A and 5B illustrate the result of the enlargement of a zone of the screen homologous to a key of the keyboard,
FIGS. 6A to 6D illustrate an embodiment of a tiling of a selection space,
FIGS. 7A to 7C illustrate a way of filling a residual space of a selection window,
FIG. 8A represents the steps enabling cursor positioning to be performed,
FIG. 8B represents the path of the finger on the keyboard when a cursor is positioned according to the steps of FIG. 8A,
FIG. 9 represents a way of navigating a menu,
FIG. 10 represents a way of making a short-cut of a word,
FIGS. 11A to 11C show the steps for making an object selection by means of a tactile contour framing a display screen.

 The interface described below is not incompatible with the use of a touch screen occupying its entire available area: it is then sufficient, in this case, to show, on demand, the keyboard as it is described in the following at the bottom of the screen.

 A device according to the present invention is designated by the general reference 10 in FIG.

This device comprises a keyboard 20, a touch screen 30 associated with the keyboard, and a display screen 40. Advantageously, the keyboard 20 is constituted by a number of keys 21 less than the number of letters of the alphabet. This reduction in the number of keys makes it possible to make a keyboard of small size, having a spacing between the centers of two adjacent contiguous keys, that is to say between about 1.5 cm and 2 cm. Such spacing between the keys facilitates the input of a text and contributes to considerably reducing the number of typing errors that may occur compared to a conventional keyboard made to the same dimensions.

 In Figure 1, the keyboard 20 has twenty keys 21 corresponding to the twenty most common letters of the alphabet. The arrangement of these letters on the keyboard is inspired for example by the structure of the Latin alphabet and is such that the eye of a user, even casual, quickly locate the key he wants to operate.

 Of course, the layout of the letters on the keyboard can be completely different and derive, for example, keyboards type "AZERTY" or "QWERTY". Likewise, the numbers of keys, lines and columns are not limited to those shown in FIG.

 The touch screen 30 associated with the keyboard 20 can display and then enter one or more characters not shown on the keyboard, but similar phonetically and / or graphically and / or semantically to a character written on the keyboard. Thus, in the example shown in Figure 1, to enter the letter "W" it is sufficient, at first, to type the key "V" on the keyboard so as to cause the display on the touch screen 30, of the letter "W" which is similar to it. In a second step, we type on the letter "W" appeared on the touch screen to control its display on the screen 40. In the same way, it is possible to display the letter "K" via from the letter "Q", the letters "X" and "Z" through the letter "S", the letters "J" and "Y" through the letter "I" etc ... .

Finally, the character "space" is entered by tapping on a portion of the touch screen 30 located between the "menu" and the space reserved for the display of similar characters.

 In an alternative embodiment, it is also possible to envisage the realization of "keyboard shortcut" consisting for example of typing three times in a row on a key to display, directly on the display screen 40, the character similar to the character written on this key. In this case, there is a delay between two successive strikes which must be less than a certain duration to, possibly adjustable by the user. This case may well be realized since the need to write three identical letters in a row is extremely rare. Moreover, in the case where several similar characters are associated with a character written on the keyboard, the "keyboard shortcut" will advantageously be provided for the most common similar character.

 The similar characters, not shown on the keyboard, are advantageously recorded in a memory of the device.

The table below gives a non-exhaustive list of similar characters associated with the so-called main characters written on the keyboard.

<tb> CHARACTERS <SEP> CHARACTERS
<tb> MAIN <SEP> SIMILAR
<tb><SEP> A <SEP> to &commat;
<tb><SEP> C <SEP> ç <SEP> c '
<tb><SEP> D <SEP> $ <SEP> dt <SEP>
<tb><SEP> E <SEP> eèêë <SEP>
<tb><SEP> I <SEP> JY
<tb><SEP> L <SEP><SEP> 1 '
<tb><SEP> M
<tb><SEP> O <SEP> ôO <SEP>
<tb><SEP> P
<tb><SEP> Q <SEP> K
<tb><SEP> S <SEP> XZ
<tb><SEP> U
<tb><SEP> V <SEP> W
<tb><SEP> = <SEP> 7L
<tb><SEP>)<SEP>]}>
<tb>"spacing"<SEP>"<SEP>"<SEP>"tab"
<tb><SEP> + <SEP>&
<Tb>

 In some cases when the characters similar to a main character are too numerous to be all displayed simultaneously on the touch screen, to reach the desired character, it will be necessary to follow the striking of the main character of two successive keystrokes on the touch screen. . Thus, to display the character "ê" for example, one will tap on the main letter "E" then on the similar letter "é" appeared on the touch screen, and finally on the letter "ê" which will have replaced the " é ". However these cases being valid only for a number of similar characters higher or equal to 3, they are rather rare.

 In an alternative embodiment, the touch screen 30 may be replaced by a simple touch bar. In this case, the similar characters will be displayed, for example, at the bottom of the display screen 40, and the entry of one of them will be done by pressing an area of the touch-sensitive bar situated opposite the chosen character.

 It is also possible to display directly on the screen 40 the characters represented on the intermediate spaces 22 located between two adjacent keys 21 of the keyboard. To do this, simply press simultaneously the two contiguous keys located on either side of the character to display. Thus, to display the character "(", for example, just press the "D" and "F" keys simultaneously.) In the same way, the "correction", "input" and "uppercase" commands are Examples are activated by simultaneously pressing the "U" and "R" keys, the "T" and "V" keys, and then the "A" and "B" keys respectively.

 This device makes it possible to quickly enter a standard text in French language and only less than 20% of the character entries are made by one of the simultaneous or successive keystrokes described above.

 The structure of the keyboard 20 can of course apply to other scripts than the Latin alphabet.

It can for example apply to different Japanese syllabaries. In addition, the main letters represented on the keys 21 of the keyboard will not be the same according to the country of marketing of the device.

 FIG. 2 represents a schematic diagram enabling a better understanding of the operation of the device according to the invention.

 The device comprises, in addition to the keyboard 20, the touch screen 30 and the display screen 40, a microprocessor 80 able to manage sequentially the information transmitted to it from the keys of the keyboard 20 or virtual keys of the touch screen 30.

 The microprocessor 80 comprises a non-volatile program memory of the ROM or EEPROM type, for example, not shown in FIG. 2. It furthermore comprises various control means each enabling specific instructions to be executed.

Thus, control means 50 of the touch screen 30, actuable by the keys of the keyboard 20, allow to perform both
the display, on the touch screen 30, of alphanumeric characters not shown on the keyboard 20 but similar to those written on the keys of the keyboard 20, and
the display, on the main screen 40, of the alphanumeric characters represented on the keyboard 20.

 Preferably, a list establishing agreement between the similar characters and the main characters, such as that presented in the table previously described, is stored in the non-volatile memory.

 Control means 60 of the display screen 40, operable either by the keys of the keyboard 20 or by the virtual keys of the touch screen 30, are used to trigger the display, on the display screen 40, of a character, or a command, written respectively on a key of the keyboard 20 or on a touch of the touch screen.

 Finally, association means 70 are provided to control the display on the display screen 40 of a selection window and to correspond, by position analogy, to each alphanumeric key of the keyboard 20 a homologous zone of the selection window. These means are useful for making a keyboard selection of objects on the screen. Their operation is described in more detail in the following. These means 70 can be activated by the keys of the keyboard and / or by the keys of the touch screen.

 When one is in a word processing application, the keyboard 20 can be configured by default in this word processing mode T. However it can also be configured in object selection mode S.

In this case, the configuration in S mode is triggered by the keystroke of one or more specific key (s) on the touch screen or on the keyboard.

 Thus, for example, to switch from character input mode to object selection mode, you can tap a "menu" key on the touch screen; then select by keyboard, by the selection method described below, the "selection" item appeared on the display screen 40 after the key "menu" key. Conversely, to switch from the object selection mode to the character input mode, you can tap the same "menu" key on the touch screen; then select by keyboard, by the selection method described below, the "text" item appeared on the display screen 40 after the key "menu" key.

 Of course this example is not limiting and it can further be provided that the simultaneous striking of several keys, the keyboard 20, having a specific configuration will make these changes of mode. In this case, it will also be possible to define a relatively long typing time, for example 0.3 seconds, to actuate the switchover from the text mode to the selection mode, as well as the immediate opening of a selection window corresponding to the hit key.

This is also valid for switching from the selection mode to the text mode and the immediate display on the display screen 40 of the character corresponding to the hit key.

 According to the configuration mode of the keyboard, the microprocessor 80 is then able to determine the characteristics of the hit key. Thus, when the keyboard is configured in word processing mode T, the microprocessor determines the character or the function associated with the hit key. On the other hand, when the keyboard is configured in object selection mode S, the microprocessor 80 determines the position, that is, the coordinates, of the hit key relative to the dimensions of the keyboard, so as to match it. a counterpart area on the screen. This homologous zone is defined as being the result of a homothety, or more generally of an affine transformation, between the dimensions of the keyboard 20 and those of a selection window appearing on the display screen 40. In this case , the keyboard 20 becomes a controller for designating something on the screen.

 The microprocessor 80 then interprets and manages the information from the keyboard 20 and transmits to the various control means series of instructions to be executed so as to trigger the display on the display screen 40 and / or on the touch screen 30 , of the function associated with these instructions.

 When the keyboard is configured in T mode, for example, and the key typed corresponds to the letter "V", then the control means 50 trigger both the display on the touch screen 30, the similar letter " W ", and the display, on the main screen 40, of the main letter" V ". A second strike then allows either to replace the letter "V" displayed on the main screen 40 with the letter "W", or to confirm the display of the letter "V". Indeed, if the second typing is performed on the virtual key "W", displayed on the touch screen, then the control means 60 trigger the display on the screen 40, the "W" which is to replace the "V". On the other hand, if the second strike is made outside the part of the touch screen reserved for similar characters, then the control means 60 confirm the display on the main screen 40 of the letter "V" corresponding to the first touch hit. In addition, the control means 50 simultaneously control the display on the one hand on the touch screen 30, the similar character, if it exists, to that of the second hit, and secondly on the main screen 40 , of the main character corresponding to this second strike.

 In addition, when two contiguous keys of the keyboard 20 are hit simultaneously, then the microprocessor 80 returns to the control means 60 the order to display on the screen 40 the character written in the space between these two contiguous keys and the touch screen display 30 of the corresponding similar character (s) if they exist.

 When the keyboard is configured in S mode, for example, then the association means 70 control either the immediate selection of one of the objects to be selected, or the display on the main screen 40 of a selection window containing all objects that can be effectively selected by a subsequent strike.

 Figures 3A to 3F illustrate examples of what a user sees on the screen when he wants to select an object via the keyboard. Eleven selectable objects are represented in a maximum selection space Emax. In the example illustrated in FIGS. 3A to 3F, this maximum selection space E max is defined by the entire surface of the screen 40, but it may of course have dimensions smaller than that of the screen.

 The grid shown in dashed lines on the maximum selection space Emax of the device of FIG. 3A is optional. However, it makes it possible to highlight the sharing of the maximum selection space E max in as many zones Z as keys 21 on the keyboard 20. Each of these zones Z corresponds, by analogy of position, to a keyboard key. It is on this correspondence that the principle of selection by the keyboard rests. In fact, this grid makes it possible to visualize the result of a homothety, or more generally of an affine transformation, between the zones Z of the maximum selection space and the keys 21 of the keyboard 20.

 Therefore, if a user wishes to select object n02, he will have to hit the "E" key. Indeed, the zone Z of the so-called "homologous" selection space at this "E" key surrounds the object n02 to be selected. In addition, since this zone homologous to the "E" key surrounds only the object 2, the latter is selected from the first hit on the "E" key.

 On the other hand, if a user wishes to select the object n05, the procedure is slightly complicated since the four objects numbered 5, 6, 7 and 8 share the same zone homologous to the "F" key of the keyboard 20. In this case a first tap on the "F" key allows to enter on the screen a new selection space, smaller than the previous Emaxi maximum selection space also reproducing the structure of the keyboard and cut into rectangular selection blocks P, represented in solid lines in Figure 3B, each containing one and only one of the objects on which the ambiguity relates. This new selection space divided into selection blocks is again referred to as the selection window F and is represented in thick black lines on the screen of FIG. 3B. This selection window F appearing on the screen then indicates the part of the keyboard in which the user must hit in order to select the desired object. This part of the keyboard is homologous to the selection pad surrounding the object to be selected.

Thus, in FIG. 3B, it is found that it is necessary to type in the part containing the "D", "F" and "M" keys of the keyboard 20 so as to be able to select the object 5. In the same manner, it is sufficient to type in the part of the keyboard containing the keys "A", "E", "I", "B", "C" and "L" to select the object 3.

 It is also possible, in an alternative embodiment, to perform a marking of the homologous zone Z corresponding to the first hit key, that is to say the "F" key in the example of FIG. 3B. . This marking is shown hatched in FIG. 3B.

 Another embodiment variant, also shown in FIGS. 3B to 3F, consists in pre-selecting the object in the block containing the homologous zone Z to the first hit key. This preselection is highlighted on the screen by a representation of the object in reverse video. Thus in Figure 3B the object n05, located in the box containing the homologous zone Z to the first key hit "F", is preselected. This pre-selection facilitates the subsequent selection, in particular if it is the preselected object that one wishes to select. Indeed, in this case just make the selection by hitting again on the key that has just been struck and which has commanded the appearance of the selection window.

 Finally, in another variant, it is possible to "zoom in" to the selection window prior to its display.

 As for the maximum selection space Emax of FIG. 3A, the dotted grid appearing inside the selection window F is optional. However, it makes it easier to locate Z homologous zones to the keys of the keyboard 20.

 On the other hand, if the density of objects to be selected does not make it possible to draw a selection window F comprising contiguous blocks of rectangular shape each surrounding a single object, the operation is carried out in three steps.

 The object selection procedure also makes it possible to access object n05 not only by the "F" key corresponding to the homologous zone surrounding this object, but also by the neighboring keys; at least if the density of objects in this area of the maximum selection space is not too great.

 This gives the user as little accuracy as possible for the first hit. In the same spirit, the "F" key also allows the selection of neighboring objects of its homologous zone, that is to say objects 3 and 4 in the example of Figure 3B.

 FIGS. 3C to 3F illustrate the manner in which object 5 is accessed when the first keystroke is performed on the keys adjacent to the "F" key.

 FIG. 3C corresponds to a first tap on the "C" key situated above the "F" key; Figure 3D corresponds to a first tap on the "M" key to the right of the "F" key; FIG. 3E corresponds to a first tap on the "D" key to the left of the "F" key; and finally Figure 3F corresponds to a first tap on the "H" key located below the "F" key. Each of these keys adjacent to the F key is used to select the object n05 during the next keystroke.

 The homologous areas Z highlighted in hatched in FIGS. 3B to 3F correspond to the homologous zone of the first struck key. The selection window F appearing on the screen differs, depending on the first key hit, by its size, its position and its tiling.

 In FIG. 3E, for example, when the first striking has taken place on the "D" key to the left of the "F" key, the user finds that he just has to press the key immediately to the right of the "F" key. this key "D" to select the object n05.

 In FIG. 3D, when the first striking has taken place on the "M" key situated to the right of the "F" key, the user finds that he has only to type in the part of the keyboard 20 containing the "A" keys. "and" B ", located at the top left of the" M "key, to select object n05.

 Thus, if the preselection is performed in an analog mode during the first strike, that is to say by analogy between the position of the first key struck on the keyboard and that of the area surrounding the object to be selected on the screen it is according to a differential mode that the second strikes, and possibly the subsequent strokes, makes it possible to make the final selection.

 A compromise must also be made on the size of the selection window F. Indeed, if it is too large and includes a maximum number of objects, it requires the user a second typing more precise and less easy. On the other hand, if it is too small then it is the first strike that must be more precise.

 In general, a selection window is defined as a rectangular space, appearing on the display screen at the time of typing on a key of the keyboard, and containing all the objects that can be selected by one or more subsequent keystrokes . This rectangular space is itself divided into several rectangular spaces, still called selection sub-windows, homologous to one or more keys of the keyboard and each containing zero, one or more objects. When one of these homologous rectangular spaces is selected, it becomes itself a selection window and the process is iterative.

Figure 4 illustrates such a selection window
F, divided into pane f, f2, tfn selection each of which is homologous to one or more keys 21 of the keyboard 20; and where the final selection of the desired object, because of a high density of objects on the screen, will be in two and no longer in a subsequent strike. To select an object from a sub-window, it is first necessary to select this sub-window, according to the differential mode already described.

 In FIG. 4, the fn selection sub-windows, dividing the window F displayed on the display screen 40, are provided with a visual guide 45 composed of very thin segments connecting each lateral object of each fn sub-window. to the corresponding central object.

This visual guide is used to highlight the path that must follow the finger on the keyboard to select an object. Of course, the visual guide shown in Figure 4 is only an example and other aids can be considered.

 In this example, the selection of an object is done in three steps. A first tap on a key 21 of the keyboard 20 makes it possible, in a first step, to open a selection window F, itself divided into sub-windows. The central pane, the counterpart of the hit key, is then preselected. In FIG. 4, the first tap on the "L" key makes it possible to open a selection window F whose central sub-window fl, homologous with at least the "L" key hit, is preselected. This preselection is highlighted in Figure 4 by a thick black line.

 A second keystroke on another key 21 of the keyboard 20 then makes it possible to select a selection sub-window in which the object to be selected is located. Thus, to be able to select 1 the object 12, shown in Figure 4, must first select the sub-window f2, containing this object, located above and to the right of the central sub-window f1 preselected. For this, it suffices to tap a key 21 of the keyboard 20 homologous to the sub-window f2, that is to say on the upper right key relative to the key first strike "L", that is: on the "O" key.

 This second strike may also make it possible to preselect an object located at the center of the sub-window 2. This pre-selection is represented in hatched lines in FIG. 4 and corresponds, for example, to a reverse video function. When a sub-window is selected, the other sub-windows disappear or go grayed for example, and said selected sub-window becomes the current selection window that can be either paved or again divided into selection sub-windows according to the case.

 A third and last keystroke on another key 21 of the keyboard 20 then makes it possible to select the object 12. To do this, simply press the key of the keyboard, homologous with the position of the object 12 in the sub-window f2 . In Figure 4, the object 12 is just below the preselected central object. Therefore, pressing the "P" key, located just below the second key "O", selects the object 12.

 The example which has just been described is not exhaustive since the method is iterative and can be repeated several times.

 This object selection, based on the opening of one or more successive selection windows, is performed in a differential mode. In addition, it advantageously allows successive keystrokes on contiguous keys of the keyboard. Finally, the visual guides 45, mentioned above, allow the user to see, from the first touch, the angle that the path of his finger must now draw on the keyboard to reach the desired object.

 In the case where the selection window is divided into blocks each containing one and only one object to be selected, the procedure for paving this selection window F takes place in two stages. First, the homologous zone Z of the first struck key is enlarged, so as to encompass the maximum number of objects for the subsequent selection. It is then divided into several selection blocks P of rectangular shape, each containing one and only one object and one or more homologous zones k each associated with a key of the keyboard 20. This tiling thus makes it possible to indicate the relation between each object located in the selection window and the keys of the keyboard 20 which allow to select it.

The result of the enlargement of the homologous zone Z of a key is represented in the figures
SA and 5B. The square Z appearing inside the total selection space Total in FIG. 5A, represents the homologous zone of a key of the keyboard that has just been actuated. The total selection space is defined as a rectangular space containing all the objects to be selected; it is either the screen itself or part of the screen.

 The homologous zone Z contains a cloud N of points that can be selected during the next strike. If the objects to be selected are not punctual, the points represented schematize the centers of these objects.

To allow the first keystroke to have a certain margin of error, the homologous area Z is enlarged to form a selection space Z ', as shown in FIG. 5B. This selection space Z 'makes it possible to select a cloud N' containing a number of objects greater than or equal to the number of objects of the cloud
NOT.

 The selection set N 'is defined as being the set of objects situated inside the selection space Z' and which must be selected later. The selection space Z 'further comprises homologous zones k each corresponding to a key on the keyboard.

 The enlargement of the homologous zone Z is carried out in successive increments, according to a method well known to those skilled in the art, until a final value of the dimensions of the selection space Z 'is obtained. Its dimensioning is left to the discretion of the software designer and results from the obligation of a compromise between the precision required at the first strike and that requested at the second strike. It may for example be the result of a report homothety 2 on the homologous zone of the first strike key.

 The enlargement of the homologous zone Z, also called initial selection space, consists in particular in detecting if there exists an object 0, of coordinates (x, y), which belongs to the maximum selection space Emax, outside and the most as close as possible to the Z selection space. The maximum selection space is defined as a rectangular space between the initial selection space and the total selection space, within which the window must be located. Selection.

 If this object exists, then the new coordinates of a new selection space Z 'are calculated. This new selection space Z 'is then the smallest rectangle encompassing both Z and the nearest object O, with coordinates (x, y).

 Moreover, the new selection set N 'contains not only the objects of the set N contained in the space Z and the object O of coordinates (x, y), but also other possible objects situated at the same distance from the Z selection space.

If [x1, y1], [x2, y2] are the diagonally opposite vertex coordinates respectively lower left and upper right of the selection space Z, then the new corresponding coordinates [X1, Y1], [X2, Y2] of new space Z 'are calculated from the following expressions:
X1 = x1 - 1/2 [x1 - x + Ix1 -x1];
X2 = X2 + 1/2 [x - x2 + Ix - X2I];
Y1 = Y1 - 1/2 [y1-Y + y1-yI]; and
Y2 = y2 + 1/2 [y-Y2 + y-Y2 in
Once the final dimensions of the selection space Z 'have been calculated, it is necessary to proceed with the tiling of this space so as to obtain a selection window.

 For this purpose, we draw within the space Z 'of selection of contiguous rectangular blocks, called selection blocks, consisting of one or more homologous zones k. Each tile contains one and only one homologous selection zone, i.e., one and only one homologous zone k surrounding a selectable object, so as to require minimal precision of the final selection keystroke.

 Paving can be done in three different ways: by successive assignments, by successive divisions, or by successive substitutions.

 The method of successive assignments consists of ordering the objects and successively assigning to these objects rectangular blocks that encompass them, while respecting the constraints of non-recovery and homogeneity. One of the possible solutions is then searched for one or more of the most "readable" solutions.

 The method of successive divisions consists in dividing in two successively, either horizontally or vertically, the selection space and then the "son cobblestones" resulting from these divisions. These divisions are performed by choosing the one or two best solutions according to the criterion of minimization of the variance of the densities of objects relative to the two new blocks created by an elementary division, and until each block comprises only a single object. The solution or one of the most "readable" solutions is then sought.

 Finally, the method of successive substitutions is to look for an initial tiling of the selection space and to make, from this initial tiling, substitutions, or exchanges of territories, between contiguous blocks while preventing themselves from reducing homogeneity. paving with each substitution. One of the solutions chosen is one, or one of those, that best meets the above criteria.

 When the tiling is performed by successive assignments, the objects are initially ordered for example from left to right and from top to bottom as shown in Figure 6A.

 A "neighbor" of an object On of the final selection set N 'is defined by a homologous zone k whose distance to the homologous zone k (On) of selection of this object On is less than or equal to that of the zones counterparts of other objects of N '. A "real neighbor" of the object On is defined, as for it, as being a zone whose distance to the homologous zone k (On) of selection of this object On is strictly lower than that of the homologous zones of the other objects of NOT'.

 The neighbors V and real neighbors W of the object O4 are represented in FIGS. 6A to 6C in hatched lines. FIG. 6B more particularly represents a circumscribed rectangle C (O4) of the object O4 and FIG. 6C represents the selection pad P4 of 04.

Finally, FIG. 6D represents the selection window F resulting from the tiling of the selection space Z '. A selection block P1, P2, ... Pn is assigned successively to each of the objects 01, 02, ... On, while respecting the following constraints:
- it must not cover the selection blocks of the preceding objects,
- it must not render "unassignable" a homologous zone k not yet allocated to a block,
- it must not contain more than one object n '
- the selection pad Pn must be inside the circumscribed rectangle C (On),
- its surface must be less than Cl * SURn, where C1 is a reducing coefficient between 0 and 1 and where
SURn is the surface of the circumscribed rectangle of the object nt and finally
it must have a number of true neighbors greater than or equal to C2 * N (W), where C2 is a second reducing coefficient and N (W) is the number of true neighbors of On.

 The first three constraints are in fact related to the very nature of the problem, which consists of searching, for a final space Z 'of selection, a tiling (first constraint) complete (second constraint) and unambiguous (third constraint) allowing the subsequent selection objects of the set N 'of selectable objects.

The fourth, fifth and sixth constraints are imposed to avoid the combinatorial explosion of possible assignments. If for example C1 = 0.75 and
C2 = 0.5, then the number of selection blocks assignable to the object Ol of FIG. 6A increases from 6 to 3 and the number of assignable blocks relating to the object O4 increases from 9 to 6. By imposing on the block selection of an object to have a dimension roughly consistent with the importance of its vicinity, the list of possible tilings obtained by this method is likely to contain one or more tilings of good readability. On the other hand, it is clear that for Cl = 1 and
C2 = 0, the fifth and sixth constraints no longer exist.

To check the "affectability" of the part not yet paved, also called residual space Er, it is first taken from a list of unallocated homologous zones, the homologous zone k having the following properties:
- it is situated as far left as possible on the right-hand side of the last installed Pn paver,
- it is the highest of the zones having this property,
- it is empty,
- it is not affected yet.

 If such a zone does not exist, the affectability is demonstrated, otherwise we search among n + 1 0n + 2 etc, an object O such as the selection pad P, whose ends are the zone itself and the zone containing the object 0, does not cover any already installed tile nor any object of the set N 'of the selectable objects. If such a tile does not exist, there is no affectability of the unpaved area. In the opposite case, the zone not yet paved is assignable as well as all the homologous zones contained in the block P. It then removes these assignable zones from the list of unallocated homologous zones. We repeat the operation until this list is empty and in this case it is a success; or until one of the areas encountered is not assignable and in this case it is a failure.

 This affectability test can not by definition be carried out after the placement of the last selection block, although it may happen that certain elementary zones, necessarily situated in the right or the bottom part of the selection space Es, are not not yet affected.

 In this case, an additional procedure, illustrated in FIGS. 7A to 7C, makes it possible to fill this residual space Er. For this, one searches among the selection blocks having a common border with the residual space Er, an "extensible" block, that is to say a block such that one of its sides constitutes the common border with the residual space Er. We then "extend" the block in question to the maximum. We repeat the operation until the final filling of the residual space and in this case it is a success; or until there is no new extensible contiguous tile, in which case the procedure fails. A "backtracking" procedure, better known as backtracking, automatically returns to the previous operation when the first result proved to be bad.

 Finally, we obtain a list of possible tessellations of the selection space from which we select the most "readable" for a user through a program common to different paving processes and described in what follows.

 When the tiling is carried out in successive divisions, the selection space Z 'is cut by a vertical or horizontal segment into two "child blocks" each containing at least one object of the set N' of selection. The operation is repeated on all the "child pavers" until each pavement obtained contains only one object and only one.

 To avoid here also the combinatorial explosion of solutions, we retain at each stage only some of the possible divisions. The divisions retained are those which best respect the homogeneity of the densities "d" of the "son cobblestones", where d = N (O) / N (k) and N (o) and N (k) are respectively the number of of objects and the number of homologous zones k belonging to a given block. The constraint to be fulfilled is thus measured by the number of divisions retained at each step, in the decreasing order of homogeneity of the son cobblestones.

 A list of possible tessellations of the selection space from which the most "readable" is chosen for a user is then obtained by means of the program described in the following.

 When the paving is carried out by successive substitutions, it is first of all carried out successive divisions to obtain very quickly a first tiling. The first tiling is memorized then it is replaced by another tiling obtained by exchange of territories between certain contiguous blocks. This substitution must be made while respecting the constraint according to which the new paving must be at least as homogeneous as the first, that is to say that the ratio of the densities of the two pavers concerned of the second paving is closer to 1 than the ratio of the densities of the two pavers of the first pavement.

 Two modes of exchange of territories are possible: the simple exchange or the crossed exchange. The simple exchange consists, when two blocks are contiguous, to assign the "border area" of one to the other provided that it is compatible with the position of the selected objects and with maintaining the rectangular shapes of the resulting tiles. Cross exchange consists, when two cobblestones are contiguous, to substitute, at their common border, a new boundary perpendicular to the first. The operation is then repeated, keeping in memory all the new solutions obtained, until the possible solutions are exhausted.

 A program common to all the procedures that have just been described makes it possible to choose, from the tilings obtained, the most readable solution for a user.

For this, the most readable solution is chosen according to one or more of the following criteria, given in decreasing order of priority:
- Graphical simplicity; it is inversely proportional to the number of nodes of the graph constituted by the tiling,
- Homogeneity of recovery; it is inversely proportional to the variance of the surface of the pavers,
minimizing the average distance between the homologous zone of the first strike key and the different selection blocks of the selection window,
- Pavers shape: they must be the most "square" possible, ie the length / width ratio must be as close as possible to 1,
- Repetitive patterns,
- Existence of symmetries in the drawing.

 It is easy to see that the satisfaction of all these criteria optimizes the readability of the selection window F.

 This program therefore consists in taking a list L of tilings obtained by one of the preceding algorithms and extracting an L1 sub-list of tilings of maximum graphic simplicity. Then, if the sublist L1 is composed of more than one element, one extracts a new sub-list L2 of tilings of maximum homogeneity. These extractions of sub-lists are carried out until only one tiling remains, or until the n criteria are exhausted in which case the first tiling of the list Ln is chosen.

 Positioning a cursor at any point on the screen consists of immediate application of the previous object selection process. Figure 8A shows the steps for positioning a cursor on the character. "Figure 8B shows the finger path on the keyboard to achieve this positioning.

 For this, it suffices initially, in step 1, to tap the key on the keyboard to open a selection window F containing the character on which you want to position the cursor.

This selection window F is itself divided into nine counterparts of a set of nine keys of the keyboard, the first key is the central key. Of course the number of sub-windows is not limited to nine, it can be higher or lower. The central pane f1 is also preselected by the first keystroke. This pre-selection is represented in hatched lines in FIG. 8A.

The keyboard key to open the window
F of selection is for example the coordinate key (3,3); the first digit designating the number of the keyboard column from the left and the second digit designating the keyboard line number from the top. This first hit of the key (3,3) is designated by the number 1 in FIGS. 8A and 8B.

 In a second step, a second keystroke on another key of the keyboard makes it possible to select the sub-window f2 containing the character "A". In FIG. 8A, this sub-window is located just above the preselected central pane f1. Therefore, to select this p-pane, just press the key just above the first-time key (3,3), ie the coordinate key (3,2). This second strike is designated by the number 2 in FIGS. 8A and 8B.

 The sub-window f2 then becomes a current selection window divided into nine sub-windows.

 A third step then consists in typing on a key of the keyboard homologous to the selection pane f'2, of the window f2, containing the character "1" and situated at the bottom left of the preselected sub-window and represented in hatched lines in Figure 8A. The homologous key is therefore the coordinate key (2,3). The selected f'2 pane then becomes a current selection window divided into four sub-windows. It then appears on the screen that the character "A" is located in the selection window f'2 just to the left of the preselected sub-window. Therefore, to position the cursor on the character "-" it suffices then to press on the key of coordinates (1,3), located on the left of the key (2,3) of third strikes. This fourth and last strike is designated by the number 4 in FIGS. 8A and 8B.

 The positioning of a cursor by this method using the sub-fenestration principle, is very precise. Of course this example is not limiting and it is possible to perform a cursor positioning by selecting a number of sub-windows higher or lower.

 The cursor positioning method is not incompatible with the use of cursor keys, whether they appear hard on the keyboard or they appear on the touch screen at the moment of selection. They can be used in particular to correct a positioning performed erroneously or in a method insufficiently precise.

 The navigation in the menu of an application is illustrated in Figure 9. It is done by typing a touch "menu" on the touch screen for example, resulting in the appearance of a first menu, in a selection space Z 'on all or part of the screen. This selection space Z 'is preferably in the form of a table of 8 headings, or even 12 headings at most, so that the choice of the right heading can be done by a single key.

 The procedure is then iterative until the desired item is selected. In the example shown in FIG. 9, the user first taps on the left-hand part of the third line of the keyboard in order to select the "style" section and to display a submenu giving the choice between the size and the style of the letters.

The user then taps on one or more keys of the third line of the keyboard, but preferably on the key he just hit, to select the heading "letter style" and display a second sub-menu. In the same way, the user taps on the left part of the third line of the keyboard a third time in order to select the "standard" heading. The preselection of the "letter style" and "standard" items follows the same principle as the preselection in the "analog differential" selection procedure: it memorizes the position on the keyboard of the key that has been previously hit to obtain the new one. -menu and allows you to perform the next keystroke in a differential mode.

 In an alternative embodiment, it is possible to perform "keyboard shortcuts" by simultaneously striking two or more non-contiguous keys, or at least not having any other meaning in the particular context of the keyboard. application. Thus, in FIG. 9, the drawing which appears in the section corresponding to the "Bold" command indicates that this command could have been activated directly by pressing simultaneously on the first and the third key of the keyboard line corresponding to this command. , that is the last line. Similarly, to activate directly the command "underlined", just tap simultaneously on the first three keys of the first line of the keyboard.

 In an alternative embodiment, it is possible

 In another variant embodiment, it is possible to make word entries faster than simply typing the letters that compose them. For this, a set of known words is stored in a memory of the microprocessor. Thus, a set of words, stored vocabulary, beginning with any sequence of letters can be displayed on the display screen 40. Figure 10 illustrates an example of such a shorthand typing of a word that builds on a dictionary of the French language. Short entry of a word is done in two steps. First, the first four letters of the word are typed using the keyboard 20, configured in T word processing mode, and / or the touch screen not shown in FIG. 10. Then the keyboard is automatically configured in selection mode. S objects and stored words, beginning with the sequence of previously typed letters, are displayed on the screen 40.

 If the word that the user wishes to type contains a number of characters less than or equal to four for example, we type the corresponding letters and we end with a "space" by pressing the corresponding virtual key on the touch screen. In this case, there is no change from a standard typing. On the other hand, if the word contains more than four letters, for example if it is the word "naturally", then just after the typing of the fourth letter the keyboard goes into object selection mode S and the processing means control the display of a table 42 at the bottom of the main screen 40. This table 42 is included in a selection window F and generally includes the most used language words and starting with the first four letters already struck: "natu". These words are usually less than eight.

 If the desired word belongs to the table 42, it is selected via the keyboard 20 configured in S mode, by position analogy. Thus, to enter the word "naturally" which is in the table to the left of the first line, one strikes indifferently on one of the three keys of left of the first line of the keyboard, that is to say on "A" and / or "E" and / or "I".

On the other hand, if the desired word does not belong to table 42, then one indicates either by a prolonged strike, or by a double strike on the last struck key, "U" in this example, that one wants to continue the striking of the word in a classic way and reconfigure the keyboard in word-processing mode
T.

 The reinforced frame of the word "nature" in the selection window F, represented in FIG. 10, reminds the user of the zone of the keyboard on which he has typed the last letter "U", to facilitate the subsequent selection on the differential mode, as previously described.

 The distribution of words in Table 42 is not necessarily random. Indeed, it is possible to place in the box of the table corresponding to the last struck key the most used word of eight.

Thus, if a user wants to select the most used word, it is enough to hit a second time in the same place. Similarly, the position farther away from the other words from the last-hit "U" key will be an inverse function of their frequency of use in the language.

 If the selected word is invariant, such as "naturally", its selection includes entering the "space" character at the end of the word.

On the other hand, if the ending of the word is variable, two cases arise:
- if it is a noun or an adjective; possible endings are few (e, s, es, aux ...). They are then displayed on the touch screen just after the selection of the word, and the choice of the correct termination, by action on the virtual key of the touch screen, also leads to the addition to the screen character "space";
- if it is a verb, the potential endings are numerous and one proceeds to a selection of the same type as the abbreviated typing of a word, by the selection of the ending in a table displayed on the screen.

 The device according to the invention can be presented in different ways. Its length is between 14 and 18 cm, its width is between 8 and 12 cm, and its thickness is between 1 and 3 cm. The keyboard, the touch screen and the display screen are gathered on one side.

 The device may further comprise another display screen covering the other side. This makes it possible to use the device alternately on the first side, said face side, or the second side, said side battery, depending on whether prevails the need for a strong interactivity or that to have an image as large as possible. Moreover, it is preferable, in this case, to place a tactile contour, or equipped with mechanically actuable keys, on the stack side in order to be able to make object selections by the contour.

 This contour selection is shown in Figures 11A to 11C. It makes it possible to select in two steps the nO 1 object of square shape, which can be seen in the middle of the other objects drawn on the screen 70 of FIG. 11A. In a first step, you tap on the contour opposite (horizontal or vertical) of the object 1 to be selected. We then consider as selectable by the next strike the set of objects located, with a certain margin of error, with respect to the initial position 72 of the finger. Arrows are then drawn on the screen, in a very short time, and according to a method well known to those skilled in the art, between these selectable objects and a set of points of the tactile contour 71 arranged at regular intervals or not. Finally, one hits on an area 73 of the contour, located at the end of the arrow from the desired object 1 in order to select it.

 The device further comprises one or more connectors of different kinds in order to be able to connect it to a server via a telephone line for example.

 In an alternative embodiment the man / machine pocket interface according to the invention can be applied to a radiotelephone. In this case, the device comprises not only the usual functions of the radiotelephone but also other functions, such as for example a telephone directory, a diary, a word processor and connectors offering the possibility of connecting to a messaging system. telematic servers.

 Finally, the device can be in the standard format of a paperback book and have two folds folded on top of each other.

Claims (7)

 1. Man / machine interface device pocket, characterized in that it comprises  a keyboard (20) comprising a reduced number of alphanumeric keys (21),  a touch screen (30), associated with the keyboard (20), allowing the input of alphanumeric characters not inscribed on the keyboard and the activation of contextual commands,  a display screen (40),  control means (50), operable by the keys (21) of the keyboard (20), making it possible both to display on the touch screen (30) alphanumeric characters not inscribed on the keyboard (20), and displaying on the display screen (40) characters written on the keyboard (20), and  - control means (60) of the display screen (40), operable by the keys (21) of the keyboard (20) and / or by the keys of the touch screen (30), to trigger the displaying on the display screen (40) an alphanumeric character written on the keyboard (20) or on the touch screen (30).  2. Device according to claim 1, characterized in that it further comprises association means (70) for controlling the display on the display screen (40) of a selection window (F) and for corresponding, by position analogy, to each alphanumeric key (21) of the keyboard (20), a homologous zone (Z) of the selection window (F), and in that these means are actuable by the keys of the touch screen and / or keys (21) of the keyboard (20).  3. Device according to claim 2, characterized in that the association means (70) furthermore make it possible to divide the selection window (F) into several corresponding selection sub-windows (f1, 2 '' '' fn). each, by position analogy, to one or more alphanumeric key (s) (21) of the keyboard (20).  4. Device according to claim 2, characterized in that the association means (70) further allows a tiling of the selection window (F) so that each selection pad (P) contains one and a single selectable object and one or more peer areas (k) each associated with a key (21) of the keyboard (20).  5. Device according to one of claims 1 to 4, characterized in that the control means (60) of the display screen (40) can also be actuated simultaneously by two contiguous keys of the keyboard so as to trigger viewing, on the display screen (40), an alphanumeric character corresponding to a character written in the space between said two contiguous keys.  6. Device according to one of claims 1 to 5, characterized in that it further comprises a non-volatile program memory capable of managing sequentially the information transmitted to it; and in that a list of characters not shown on the keyboard (20), but similar graphically and / or phonetically and / or semantically to those that are written on the keyboard, is stored in said non-volatile memory.  7. Device according to one of claims 1 to 6, characterized in that the keyboard (20), the touch screen (30) and the display screen (40) are assembled on a first face and in that the other side comprises a second display screen (70), over its entire surface, framed by a tactile contour (71).