FR2904712A1 - Navigation method for handicap person having immobilized hand, involves presenting set of hierarchized menus on visual interface in response to selection of one hierarchized menu from presented another set of hierarchized menus - Google Patents

Abstract

The method involves arranging a set of hierarchized menus (M`1-M`6) of a tree structure at a given instant for being presented on a visual interface in a circular manner, where the menus hierarchically depends on the same menus. Another set of hierarchized menus of the tree structure is presented on the visual interface by replacing the former set of menus in response to a selection of one menu (M`1) from the presented former menus. The selection of the menu (M`1) is carried out by a control for a handicap person having immobilized hand. Independent claims are also included for the following: (1) a computer program comprising instructions to perform navigation method (2) a data medium comprising instructions to perform navigation method (3) a computing device comprising a presentation unit (4) a computing system comprising a computing device.

Description

 NAVIGATION METHOD IN AN ARBORESCENCE, DEVICE AND

ASSOCIATED SYSTEM

The present invention relates to navigation in a tree structure comprising hierarchical elements. It is indeed useful to be able to move in a tree to search for a given element. This displacement or navigation is quite widespread in a large number of computer applications in particular.

For example, some operating systems, such as Windows, and some software, such as office software, give access to a hierarchical menu tree.

The navigation within these menus is traditionally performed by exploring the tree structure which is visible in its entirety, or by progressive deployment of the tree from the highest hierarchical level. Figure 1 illustrates a navigation of the first type mentioned above.

It shows the complete tree with its three levels of menus. The hierarchical relations between the different menus are clearly visible in the form of branches, the menus constituting endings of the branches. In this representation, the navigation can consist simply of selecting the desired menu from the set of menus M1-M10. Even if it is not part of the highest hierarchical level (that is to say if it is not M1), a menu can be selected directly according to this type of navigation.

Figures 2a-2c illustrate the successive steps of a navigation of the second type mentioned above. Only the top-level menu M1 is visible initially (Figure 2a). Then the selection of M1 results in the display of M2-M4 menus of the second hierarchical level (Figure 2b). Assuming that the menu M2 is then selected, the corresponding branch of the tree is then deployed to show menus M5 and M6 hierarchically dependent on M2. The selection of one or the other of these menus of the third hierarchical level is then rendered possible.

A benefit of navigation of the second type mentioned above is that it allows a progressive access, and thus simpler in terms of legibility, to the elements of the tree structure, which can be particularly appreciable when the tree contains a large number of hierarchical menus.

The navigation can also be applied to other types of trees, such as trees containing typographic characters for example. Thus, such a tree may for example include groups of letters and numbers in a first hierarchical level and subgroups of letters and numbers in a second hierarchical level. In the example illustrated in FIG. 3, the subgroups of the second hierarchical level each consist of a letter or a number only. The navigation in such a tree can be used for input purposes for example.

Another aspect of the navigation relates to the arrangement of the elements of the tree in which one wishes to move.

For a hierarchical menu tree, several representation types are commonly used. FIG. 4 shows a horizontal-vertical representation, that is to say that the upper level menus M1-M5 are arranged horizontally, while the lower level menus m21-m25 are displayed vertically under the menu M2 on which they depend hierarchically.

Similarly, Figure 5 shows a horizontal horizontal type representation (or type of tabs) and Figure 6 shows a vertical-vertical type representation.

When the tree in question contains hierarchical typographic characters, as mentioned above, other types of representation are generally envisaged to simulate a keyboard. FIG. 7 gives an example of such a virtual keyboard 5. A first line 1 of the keyboard contains elements relating to groups of letters and figures. Only this first line is apparent initially. Once a group of letters or numbers is selected, a second line containing the subgroups of the selected group appears on the keyboard, below the first line. In the example shown, the group of characters ABCDEF has been selected, which results in the display on the second line of the letters A, B, C, D, E and F individually. The selection of one of these letters can then be performed.

Of course, such a virtual keyboard may also include other elements, such as a space bar 3 and a return to line button 4. If the different navigation examples presented above offer advantages, such as, for example, some, a progressive access to the tree, they are however not optimal in terms of readability in particular.

In particular, the display of a large part of the tree, either immediately or after deployment of one or more branches, can make access to information complex.

Likewise, the conventional arrangements of the elements of the tree, such as the horizontal-vertical, horizontal-horizontal or vertical-vertical type representations mentioned above, imply an unnatural gymnastics of the eyes thus making navigation painful after a certain period of time. .

The present invention aims to facilitate navigation in a tree of elements.

The invention thus proposes a method of navigation in a tree structure comprising hierarchical elements. According to this method, each set of elements of the tree hierarchically dependent on the same element of the tree is arranged to be presented on a visual interface, substantially in a circle. In addition, in response to a selection of an element from a first set of elements of the tree presented on the visual interface at a given instant, a second set of elements of the visual interface is presented on the visual interface. hierarchically dependent tree of the selected element, replacing said first set of tree elements. Thanks to the circle layout of the tree elements and the fact that only the elements of a given hierarchical level of the tree are generally visible at the same time, the readability and the reliable access to the elements of the tree tree are facilitated. Such navigation is also well adapted to the physiological constraints of the eye (instability, ocular saccades around a central point, response time).

Advantageously, the selection of an element from the first set of elements of the tree is performed by ocular control. In this case, the proposed navigation is particularly effective in terms of the success rate of the selection and response time in particular. Other types of commands are also conceivable in lieu of or in addition to the ocular control, such as mental commands, voice and / or using an effector.

The invention can advantageously be implemented using a type of control adapted for people with a disability immobilizing their hands.

The central area of the circle is an anchor for the eye, from which the natural saccades of the eye are established to the elements of the tree presented on the visual interface. Advantageously, a central element can appear on the visual interface, in the central zone of the circle. It can offer a higher perception than the elements of the tree structure, to reinforce this anchoring function. A return function to the presentation on the visual interface of the first set of elements of the tree instead of the second set of elements of the tree may also be associated with it. It allows a fast ascending and easy navigation.

The elements of the tree may include typographic characters, menus, sub-menus and / or functions for example.

An element whose selection involves the action of reducing and / or leaving the presentation on the visual interface of a set of elements of the tree can be advantageously used. An element of the hierarchical level tree that is superior to the other elements of the tree presented on the visual interface at a given moment may be used in some cases.

The invention also proposes a computer program comprising code instructions for implementing, when loaded and executed by computer means, the aforementioned navigation method, according to which each set of elements of the dependent tree hierarchically of the same element of the tree is arranged to be presented, on a visual interface, substantially in a circle and according to which, in response to a selection of an element from a first set of elements of the tree presented on the visual interface at a given moment, is presented on the visual interface a second set of elements of the hierarchically dependent tree of the selected element, replacing the first set of elements of the tree. The invention also proposes a data carrier comprising storage means for the aforementioned program.

The invention also proposes a computing device arranged to allow navigation in a tree structure comprising hierarchical elements. The device comprises: means for presenting, on a visual interface, each set of elements of the tree hierarchically dependent on the same element of the tree, substantially in a circle; and

means for, in response to a selection of an element from a first set of elements of the tree presented on the visual interface at a given moment, presenting on the visual interface a second set of elements of the hierarchically dependent tree of the selected element, replacing said first set of tree elements.

Advantageously, the device further comprises oculometric means for detecting the selection of an element from the first set of elements of the tree. Instead of being integrated in the device, the oculometric means may be external to it.

Other features and advantages of the present invention will become apparent in the following description of nonlimiting exemplary embodiments, with reference to the appended drawings, in which:

FIG. 1, already commented on, is a diagram illustrating a navigation by exploration of a complete tree of hierarchical menus;

FIGS. 2a-2c, already commented on, are diagrams illustrating a navigation by progressive deployment of a hierarchical menu tree;

- Figure 3, already commented, is a diagram illustrating a navigation in a tree containing typographic characters;

FIG. 4, already commented on, is a diagram illustrating a horizontal-vertical type representation of menus of a tree structure; FIG. 5, already commented on, is a diagram illustrating a horizontal-horizontal representation of menus of a tree structure;

FIG. 6, already commented on, is a diagram illustrating a vertical-vertical type representation of menus of a tree structure;

- Figure 7, already commented, is a diagram illustrating a virtual keyboard using a known navigation technique;

FIGS. 8a and 8b are diagrams illustrating an example of navigation in a tree structure containing hierarchical menus according to the invention;

FIG. 9 is a diagram illustrating the tree to which the navigation illustrated in FIGS. 8a and 8b applies;

FIGS. 10a and 10b are diagrams illustrating an example of navigation in a tree structure containing hierarchical menus some of which relate to functions;

FIG. 11 is a diagram illustrating an example of a menu of functions displayed in the form of symbols;

FIG. 12 is a diagram illustrating a reduced icon for the menus of the tree to which the navigation applies; FIGS. 13a and 13b are diagrams illustrating another example of navigation in a tree structure containing hierarchical menus;

FIGS. 14a and 14b are diagrams illustrating a virtual keyboard based on a navigation according to the invention; and FIG. 15 is a diagram showing an exemplary device capable of implementing the invention.

The present invention provides navigation in a tree structure comprising hierarchical elements. For the purposes of this navigation, hierarchically dependent tree elements of the same element of the tree are presented on a visual interface, in a substantially circular manner.

Thus, in the exemplary embodiments which will be described here with reference to FIGS. 10a to 14b, the arrangement of the tree elements presented on the visual interface is such that it is possible to draw a circle having its center between the elements of FIG. tree and extending across all of the presented tree elements. The distribution of the tree elements on this circle may be uniform.

In addition, the elements of a single hierarchical level of the tree are generally visible at a given moment. Selecting an element from a first set of elements of the tree presented on the visual interface at a given moment causes a replacement on the visual interface of the first set of elements of the tree by a second set elements of the hierarchically dependent tree of the selected element, the second set of tree elements being here also substantially in a circle, on the visual interface.

These different aspects of the navigation according to the present invention are apparent in the example illustrated in FIGS. 8a and 8b. The tree browsed in this example is represented in a conventional form in Figure 9. It distinguishes two hierarchical levels of items such as menus for example. The first hierarchical level contains the menus M'1 to M'6. The second hierarchical level consists of menus hierarchically dependent on menus of the first level hierarchical. Thus, the menus m'11 to me14 are hierarchically dependent menu M'1, the menu m'21 hierarchically depends menu M'2, etc.

FIG. 8a illustrates the first hierarchical level of the tree considered according to the presentation mode according to the present invention. We note that the menus M'1 to M'6, all hierarchically dependent on the root of the tree (which is a kind of primary element of the tree), are distributed in a circular manner. In the example illustrated in FIG. 8a, the circle formed by the menus M'1 to M'6 is centered around a central element. The central element may have different natures. For example, it can be one of the elements of the tree. It can also consist of another type of element, for example an element referring to a given function. In the example illustrated in Figure 8a, the central element simply consists of a central button, without associated function. It therefore simply serves to materialize, visibly, the central area of the circle around which the menus are arranged. Alternatively, the central element may not appear on the visual interface In the latter case, the menus would then be arranged in a circle around a blank space.

A user having access to the visual interface can then select one of the menus M'1 to M'6 presented to him as shown in Figure 8a. For example, it is considered that the user selects the menu M'1. This selection leads to the presentation on the visual interface of the menus m'11 to me14 hierarchically dependent menu M'1, replacing the previous representation as shown in Figure 8a. Figure 8b shows the presentation on the visual interface resulting from the selection. As for the representation of FIG. 8a, the menus m'11 to m'14 are presented in a circular manner around a central element. In addition, it is noted that only the menus me11 to me 14 hierarchically dependent menu M'1 selected are represented. The menus M'1 to M'6 of the higher hierarchical level are no longer visible on this new representation, contrary to what the previous navigation techniques foresaw. At this point, the user no longer sees menus me11 to me14 and can only select one of them.

In FIG. 8b, the central element around which menus 11 to 14 are arranged is associated with a return function at the preceding hierarchical level, that is to say, in this example, the return to the representation of Figure 8a. The use of such a central button is advantageous because it facilitates the upward navigation in the tree.

The navigation described above has many advantages.

First, this navigation is progressive, since all the menus of the tree are not visible from the outset, which facilitates the search in the tree. In addition, the fact that presentations on the visual interface are superimposed on each other, so that menus generally of one hierarchical level are visible at a time, considerably reduces the complexity of the information presented. on the visual interface. The risks of confusion between menus of different hierarchical levels by the user are therefore rendered virtually non-existent.

Another advantage of the navigation according to the invention comes from the presentation of menus in circular form. Such a presentation makes it possible to adapt effectively to the physiological constraints of the eye. Indeed, the basic functioning of the eye is the peripheral saccade, that is to say that the eye makes small saccades around a fixation point. With the representation proposed by the invention, the eye can be fixed on the center of the circle formed by the menus and explore the menus arranged around this center by jerks. Such an exploration is therefore much more natural than that used traditionally and some examples of which have been described in the introduction. This results in visual comfort and increased speed by the user performing the navigation.

In addition, the advantageous use of a central element such as a central button, as illustrated in FIGS. 8a and 8b, allows the user's eye to be easily positioned in the center of the circle described by the menus. The central element thus constitutes an anchor point from which the saccades of the eye are performed, which results in a regular round trip between this central element and the various menus distributed around it circularly. Advantageously, the central element offers a higher perception than the menus that surround it so that the anchoring is made particularly efficiently. For example, this central element can be represented on a large surface and / or with a particularly visible color such as red for example.

The navigation can be performed for example using a computer device, such as the computer 1 of Figure 15 for example. In the latter case, the visual interface on which the various elements of the tree are presented uses the screen 2 of the computer 1. The selection of an element of the tree displayed on the screen can be made according to different methods. In particular, the selection may use an effector such as a computer mouse 3 for example. Alternatively, it may result from a command not requiring manual action, for example a voice command, mental or ocular. Mixed orders can also be considered. The use of eye controls will be discussed in more detail later, although it is only one of a number of examples.

For this purpose, conventional oculometric means 4 may be used to detect the movement of an eye or both eyes of the user and as well as their position on the visual interface. The selection of an element of the tree can then result from the detection of a fixation of this element by the eye of the user for a time exceeding a predefined duration. To determine the fixing time required for the selection of an element, one can for example refer to studies in cognitive psychology (in particular on reading and on the search for visual information). Thus, it can be shown that in a reading and visual search task, the average fixing time on a word is of the order of 250-350 ms. The fixation time for the selection of an element of the tree can therefore be chosen in this range. Alternatively, a fixation time of less than 250 ms may be chosen. In general, this time should not be too short, otherwise multiple untimely selections would be generated, or too long, because the eye has difficulty staying too long on one point accurate and may otherwise never reach the required fixation time.

The oculometric means can be integrated into the computing device. Alternatively, they can be separated from this device, that is external to the device, while cooperating with it via a wired or wireless connection, or via a telecommunications network for example. In this case, the assembly comprising the computer and the oculometric means constitutes a computer system capable of implementing the navigation according to the invention.

The ocular control selection of an element of the tree among the elements presented on the visual interface is particularly advantageous for use by persons with a disability immobilizing their hands. Ocular control also represents an interesting alternative to the voice command traditionally used for people with such a disability, since it is likely to be implemented including by people whose disability implies an inability to articulate or to issue sounds. Of course, the ocular control can also be used by people who do not have a motor disorder. In addition, the ocular control can be supplemented by motor actions such as typing on a keyboard with the hands or actuating an effector such as a computer mouse.

A classic problem with the use of the ocular control, known as the Midas touch problem is that the fixation time detected on an element presented on a visual interface may not be the result of the user's desire, but of difficulties. understanding of it. In addition, as indicated above, the eye operates by performing small saccades around a fixation point, the fixation point being determined by the average of these small saccades. As a result, it is difficult to accurately determine the point of attachment actually targeted by the user.

Faced with these difficulties, it is understood that the navigation according to the present invention is particularly interesting, since the arrangement in a circle of the elements of the tree which allows to provide a sufficient distance between these elements to limit the ambiguity about the element actually fixed by the eyes of the user. For example, it is more likely that oculometric means conclude that the eye of a user sets the menu M2 or m22 instead of the menu m21 in Figure 4, rather than concluding that the eye of the user sets the menu M'2 or M'6 instead of the menu M'1 of Figure 8a.

The selection of an element of the tree presented on the visual interface resulting from the attachment of this element by the eyes of the user for a certain duration, it is understood that the selection is more accurate with the arrangement of the elements of the tree according to the invention. In other words, the pointing errors and therefore the selections of inadequate elements are limited with the present invention. It can further be shown that the response time to reach a given element of the tree is improved with the present invention.

As an illustration, the statistical studies were conducted on a panel of twelve users. They were asked to navigate menus arranged in four distinct types. The first three types correspond to the horizontal-horizontal, horizontal-vertical and vertical-vertical arrangements as described above with reference to FIGS. 4 to 6. The last type corresponds to the presentation mode according to the present invention. The following indicators were determined for the panel of users: a number of successes to select a given menu in the tree, one attempt per user, a response time that corresponds to the average time taken to select the menu and an average of additional selections, ie an average number of unnecessary selections before selecting the item. The results of these statistical tests are reproduced in the following table:

Navigation

Horizontal- Horizontal- Vertical vertically vertical vertical vertical invention

Number of

Temps de réponse12 12 10 12 success stories

Response time

70.20 88.42 75.90 63.94 (ms)

Average selections 2.83 3.08 4.42 1, 92 additional

Thus, it is found that the navigation according to the invention is the most effective among the tested solutions, because it provides, for the panel of twelve test users, a success rate of 100%, and a significantly shorter response time than in other cases. In addition, the number of untimely selections is also smaller than in the other cases.

The following figures give other examples of navigation according to the invention. In particular, Figure 10a shows a first set of menus of a given hierarchical level in a tree, arranged in a circle around a central button. These menus relate to categories of functions such as they may appear in an office application for example, such as a display, a text editor or a spreadsheet. Thus, these menus include the following categories: file, editing, view, tools and format.

It is assumed that the user selects the edit menu on the visual interface, for example by ocular control. The visual interface then displays the representation shown in Figure 10b, replacing that of Figure 10a. This new representation includes elements relating to functions of the category corresponding to the selected edit menu. These functions, presented in a circle around a central element, are: cut, copy, paste, search and select all.

Advantageously, an indication of the hierarchically superior menu, namely editing, appears on the visual interface, to allow the user to find their way in the tree. As mentioned above, the central element in the representation of Figure 10b may be a button with significant visual perception, which may be advantageously associated with a return function on the previous screen. In this case, a selection of the central element of FIG. 10b, for example by ocular control, will result in a return to the representation of FIG. 10a, replacing that of FIG. 10b.

Figure 11 shows another example of circularly arranged menus, where the different menus are indicated as symbols, rather than text. These different symbols may for example correspond to the following functions: validation, next, previous, print, copy, cut, paste.

In the example of Figure 11, another element is added to the functions mentioned above. This element, which is represented at the bottom of the figure (downward arrow), symbolizes an action of reduction of the representation of FIG. 11. A selection of this symbol by the user will result in a replacement of this representation by a representation of reduced size, such as that of Figure 12 for example. This reduction makes it possible to consult an underlying element on the visual interface. Subsequently, a selection of this reduced icon can return to the representation of Figure 11.

In the example illustrated in FIG. 13a, the first set of menus of the initially displayed tree includes the application and navigation menus, which belong to the highest hierarchical level of the tree. An iconization element and an element for leaving the representation of FIG. 13a have also been added to this set of elements.

Following a selection of the applications menu, for example by ocular control, we obtain the representation of Figure 13b to replace that of Figure 13a. This includes different applications that are hierarchically dependent on the application menu. These elements relate to functions in the application menu. These functions include a text editor, spreadsheet, messaging and a web-like application. Selecting one of these items opens the corresponding application.

In addition, to this new set of hierarchically dependent elements of the application menu, it has been added the navigation element, which nevertheless belongs to the same hierarchical level as the application menu. This allows access to the navigation menu, without having to return to the top level of the tree as shown in Figure 13a. Such a mode of operation can be envisaged to provide quick access to certain menus that may be frequently used or related to the other elements presented on the visual interface. It will be understood, however, that it can not be generalized to all the menus and sub-menus, so that the user can maintain some visibility of the tree and its hierarchy.

Figures 14a and 14b illustrate an example of navigation according to the invention, wherein the elements of the tree include typographic characters. Thus, Figure 14a shows a presentation of the elements of the first hierarchical level of the tree, which include groups of letters and numbers. This set of elements also includes an element relating to the spacing character and another relating to a line break.

A selection of the group of letters ABCDEFGH, for example by ocular control, then causes the presentation on the visual interface of the set of elements according to Figure 14b. This second set of elements comprises the letters A, B, C, D, E, F, G and H, these different elements being independent of each other. Thus, the user can select any of these letters, for example for text entry purposes. Such navigation simulates a keyboard, while enjoying the benefits mentioned above.

The present invention can be implemented using a computer program comprising appropriate code instructions when it is loaded and executed by computer means. This program can be stored in or transmitted by a data carrier. This may be a hardware storage medium, for example a CD-ROM, a magnetic diskette or a hard disk, or a transmissible medium such as an electrical signal, optical or radio.

Claims (13)

R E V E N D I C A T IO N S 1. A method of navigation in a tree structure comprising hierarchical elements (M'1-M'6, m'11-m'63), in which each set of elements of the hierarchically dependent tree of the same element of the hierarchy tree is arranged to be presented on a visual interface, substantially in a circle, and in which, in response to a selection of an element (M'1) from a first set of elements (M'1-M'6) of the tree presented on the visual interface at a given instant, we present on the visual interface a second set of elements (m'11 -m'14) of the hierarchically dependent tree of the selected element, in replacing said first set of elements of the tree. 2. Method according to claim 1, wherein the selection of said element (M'1) among the first set of elements (M'1-M'6) of the tree is performed by ocular control. 3. The method of claim 1 or 2, wherein the selection of said element (M'1) from the first set of elements (M'1-M'6) of the tree is performed by a type of control adapted for a person with a disability immobilizing their hands. The method of any one of the preceding claims, wherein at least some sets of elements of the tree are shown substantially in a circle around a central element. The method of claim 4, wherein said central element is arranged to provide a higher perception than elements of said set of tree elements. The method according to any one of the preceding claims, wherein the second set of elements (m'11-m '14) of the tree is presented substantially in a circle around a central element and in which a selection of said central element again drives the presentation on the visual interface of the first set of elements (M'1-M'6) of the tree structure replacing the second set of elements of the tree. 7. Method according to any one of the preceding claims, in which at least certain sets of elements of the tree are added an element whose selection involves the action of reducing and / or leaving the presentation on the interface. visualization of the set of elements of the corresponding tree. A method according to any one of the preceding claims, wherein at least one element of the hierarchical level tree that is greater than the elements of the second set of elements of the tree is added to the second set of elements of the tree. . A computer program for a navigation device comprising code instructions for implementing, when loaded and executed by the navigation device, the navigation method according to any one of the preceding claims, wherein each set of elements of the tree hierarchically dependent on the same element of the tree is arranged to be presented on a visual interface, substantially in a circle, and according to which, in response to a selection of an element (M'1 ) from a first set of elements (M'1-M'6) of the tree presented on the visual interface at a given instant, a second set of elements (m'11 - m'14) of the hierarchically dependent tree of the selected element, replacing the first set of elements of the tree. Data carrier comprising program storage means according to claim 9. 11. Computer device arranged to allow navigation in a tree structure comprising hierarchical elements (M'1-M'6, m'11-m'63), the device comprising: means for presenting, on a visual interface, each set of elements of the hierarchically dependent tree of the same element of the tree substantially in a circle; and means for, in response to a selection of an element (M'1) from a first set of elements (M'1-M'6) of the tree presented on the visual interface at a given instant, presenting on the visual interface a second set of elements (m'11 -m'14) of the hierarchically dependent tree of the selected element, replacing the first set of elements of the tree. The device of claim 11, further comprising oculometric means for detecting the selection of an element from the first set of elements of T tree. 13. A computer system comprising a device according to claim 11 and oculometric means, external to the device and connected thereto, for detecting the selection of an element from the first set of elements of the tree.