FR2718862A1 - Optimisation method for communication between user and computer system e.g. multimedia system - Google Patents

Abstract

The optimisation method is applied to a computer system including a calculating unit (6), a display unit (2,4), a mouse, and involves running managing software to manipulate a virtual image larger than the one displayed. The method consists of using the mouse to execute an elementary action and a second hand controller for providing three elementary functions for direct image movement control.The image, or part of it, is manipulated on the screen corresp. to the user's instructions. Parameters are finely defined for selection criteria in fuzzy logic. Then a decision is made by an enable/disable command. The second computer peripheral device is operated by the user's other hand, and includes a head (18) which is movable w.r.t its rest position to provide the required degree of image position adjustment along two perpendicular axes e.g. x and y, and rotation about a third axis i.e. z axis.

Description

 The present invention relates, in general, to the dialogue between a man and a computer type machine and, more particularly to an optimization method for such a dialogue between a home and a computer type machine endowed with ulti-media capacity and including a computer, a display device in a current software application capable of managing a virtual image of size larger than that generated on the display device, and a pointing device.

 By the term 'multi-media capacity' is meant an information processing capacity which integrates the simultaneous exploitation of several types of media (texts, sounds, graphics, still or animated images), processing such as acquisition , handling, storage and transmission of all information.

 The invention also relates to a new computer peripheral for optimizing the dialogue between a hoe and a machine for the implementation of this method.

 Advances in computer science, both in terms of software and arteries, have made it possible to considerably change the habits of users who previously used to work on computer applications only using the keyboard. Currently, with the help of graphical interfaces, the user has hardware and software tools allowing the development of increasingly complex computer tasks. These tools, which clearly improve the dialogue between man and machine, have a very important role in the performance of the machine. The most representative tool is an input device of the pointing device type, generally called "mouse" or "track ball" as the case may be (also better known under the names of, respectively, "Mouse" and "Track Ball "), which gives easy access to all the elements of iiage of the complete surface of the display screen for a mobile cursor.

 The document EP-A-0 509 337 describes for example a pointing device of the "track ball" type making it possible to move a cursor over the entire surface of a display screen. This type of device generally includes a ball capable of being rotated continuously, and at least one binary co-ande button for validation.

 Document EP-AO 482 420 describes a device for controlling a cursor comprising four buttons that the user can operate, this device generating optical pulses allowing, thanks to a specific interface, very fine control of the position of the cursor on the screen.

 However, because the live memory usable in the machine has become very large (for example 16 megabinons for a small personal machine), the current trend is to put a maximum of elements on a display screen of necessarily limited dimensions.

Software applications that determine a plurality of action zones, elevators, graphic windows, icons, etc. are very often found over the entire surface of the screen, sometimes stacked virtually in depth when the surface of the screen is viewing is insufficient. On the one hand, this spoils the computer view which is more and more beautiful with technical progress and which is, moreover, often essential for the user so that he can make an appropriate decision and, on the other hand, seriously penalizes the user who must constantly change a cursor on his screen by means of the pointing device and who thus loses precious and considerable time compared to the operating speed of the machine.

 The present invention aims to overcome these drawbacks.

 According to a first aspect of the invention, it therefore relates to an optimization method for a dialogue between a man and a computer type machine including a calculator, a display device in a current software application capable of managing an image size larger than that generated on the display device, and a pointing device.

According to this first aspect of the invention, the elementary action function provided by the pointing device is shown, and the dialogue between man and machine is broken down into three distinct elementary functions.
- possible evolution of the image or part thereof on the display device so as to correspond to a virtual evolution of man compared to the image or part of image generated on the display device;
- fine paratage of the selection criteria in fuzzy logic; and
- binary decision making by validation-invalidation.

 The second aspect of the invention relates to the computer peripheral making it possible to implement the method described above. Such a device must naturally already be able to provide information in at least three dimensions. There are documents in the patent literature describing devices for providing three-dimensional information to a computer.

 EP-A-O 429 391 describes, for example, an input device comprising three acceleration detectors respectively arranged in one of the three mutually orthogonal axes. The associated electronics calculate all the position, orientation, speed, etc. data of the device for an interactive relationship with three-dimensional graphics represented on a display screen.

 Document US-A-0 516 862 describes a device very similar to the previous device of the prior art, using angular speed detectors in the same three axes. Two command buttons are added to let the computer know when to take the information taken into account.

 The purpose of such devices of the prior art is essentially to allow the control of arms of robots or automata, the realization of simulations, and the obtaining of rotations of images in three-dimensional graphic applications. They all have the major disadvantage of operating only in response to a real movement of the user or, at least, of his hand. In addition, they do not in any way ensure fine configuration in fuzzy logic of certain data essential for the proper functioning of software applications and also do not allow the user to make an electronic representation of a manipulable object which greatly facilitates use of computers. In particular, they do not allow the incorporation of human factors, which implies a decrease in reliability and, more generally, a decrease in user performance. Finally, they do not authorize the achievement of universally usable principles of use, as well with manual physical as virtual interaction; more explicitly, they do not allow a standard for multi-media type machines.

 The invention also aims to overcome these drawbacks and easily optimize the dialogue between man and machine.

 This object is achieved, according to a second aspect of the invention, by means of such a computer peripheral comprising a head having a longitudinal axis, this head being movable in translation in this longitudinal axis and in two perpendicular axes of a perpendicular plane. to the longitudinal axis, and mobile in rotation about this longitudinal axis, the position of the head relative to its rest position determining the steps of the method described above.

 Preferably, the translation of the head in the plane perpendicular to its longitudinal axis determines the corresponding evolution of the image or part of the image on the display device, while the translation of the head in its longitudinal axis determines either a corresponding in-depth evolution of the image or part of it on the display device, that is to say a binary decision by validation-invalidation, according to the current software application.

 Preferably also, the rotation of the head around its longitudinal axis determines either a corresponding rotation of the image or part thereof on the display device, or an evolution of the image or part thereof, or fine configuration of the selection criteria in fuzzy logic, depending on the current software application.

 By the expression 'fuzzy logic', we mean a nonbinary logic whose representative signal can take all the possible values between a response 0 (or 'no') and a response 1 (or 'yes').

The invention will be better understood, and other objects, advantages and characteristics thereof will appear more clearly on reading the following description of preferred embodiments given without limitation and to which two drawing plates are appended. on which:
Figure 1 shows schematically a machine of the personal computer type comprising a peripheral according to the invention;
Figure 2 shows schematically and in elevation a preferred embodiment of the device according to the invention;
Figure 3 illustrates a brake means usable with the device according to the invention;
Figure 4 shows schematically, seen from above, a preferred embodiment of the device body according to the invention;
FIG. 5 schematically represents, seen in profile and in section, the preferred embodiment of the body of the peripheral illustrated in FIG. 4.

Figure 6 illustrates an example of a display screen for a software tool of the prior art;
Figure 7 shows one of the advantages provided by the invention for a conventional display screen; and
Figure 8 illustrates a second example of advantage provided by the invention in the same situation.

 Referring now to the drawings, there will be described a preferred embodiment of the invention implementing the aforementioned optimization method for a man-machine dialogue in the context of a machine of the personal computer type with non-virtual peripherals. Obviously, this framework is in no way limiting, since the invention finds applications in machines of the industrial type of much higher capacity, with peripherals of virtual types, for example for controlling robots or the like.

 For clarity, and to more specifically differentiate the new device object of the invention from other usual devices, the computer device according to the invention will be called "Fly" in the following description (or "Fly" by correlation with other known devices). Indeed, it does not replace another device that can perform the elementary action function, but in addition, and it can compare favorably to a fly, both with regard to the virtual evolution mode of the user , as far as binary decision-making is concerned, as we will see later.

 Figure 1 shows a machine of the conventional personal computer type, but including the fly of the invention. This machine therefore comprises a central unit 6 comprising the computer function, a display device 2 including a screen 4 of cathode type in the example shown, but which could very well be a flat screen with light-emitting diodes or a touch screen thus ensuring the elementary action function, or any other type of screen. A keyboard 12 is connected to the machine, as well as a peripheral device 8 called a "mouse" moving, preferably on its mat 10, in order to make a cursor 56 evolve over the entire surface of the screen (shown in FIGS. 6 to 8) correspondingly. The fly is controlled by means of a control member 14 shown on its base 5, for example by means of the patch 36 (Figure 3). It is obvious that this control member 14 can be favorably physically integrated into another peripheral, for example the keyboard 12, the mouse 8 or the frame of the display device 2. Integration with the mouse is preferred in the sense that the mouse brings two complementary degrees of rotation quite favorable to software applications, but this integration is not at all essential.

 A preferred real embodiment of the control member 14 of this fly is more clearly shown in elevation Figure 2. This embodiment is intended, for example, to be manipulated by the hand of man left free by the use of the mouse-type pointing device. Indeed, the right hand is devolved to the left cerebral hemisphere which is generally considered for treatments of the analytical or sequential type, while the left hand is devolved to the right cerebral hemisphere to which functional skills are associated for synthetic treatments or global factors that intervene, for example, in the perception of forms or space, or even in decision-making.

 This real control member 14, as shown in FIG. 2, comprises a head 18, possibly provided with a shape, a structure and a marking facilitating its handling, mounted on a shaft or tail 16 having a longitudinal axis, the head being movable in rotation about its longitudinal axis according to the arrows 28, movable in translation in a spider or equivalent 22 made in a body 20, in the two perpendicular axes of a plane perpendicular to the longitudinal axis of the head 18 and its shaft or tail 16 (according to the arrows 24), and movable in translation in the longitudinal axis according to the arrows 26. Obviously, in the case of a hardware peripheral which can operate as input only or as input-output according to the needs of the users, the fly is connected to an interface of the machine by a cord 30 of conventional type by means of a conventional connector with 9 or 25 pins or any other number of pins. Depending on the use, we may prefer a device with remote control.

 Preferably, when the fly is not integrated into another device, as in the case shown, the control member 14 is provided with a brake means such that a manipulation of the head does not cause a displacement material of the organ, if the user does not wish to maintain it, for example, in the hand. An example of such a brake means has been shown in FIG. 3. In the example shown, this brake means comprises an adhesive pad 36, for example of hexagonal shape, capable of cooperating with an imprint made on the bottom 32 of the body 20 of the member 14. This bottom 32 then comprises two slides 34 having a relief. The pad 36, previously fixed either to a table 1 (like the mat 10 of a mouse 8), or to another device of the machine, will penetrate into the slides 34 formed at the bottom 32 of the body 20 of the member 14, thus immobilizing the fly control member 14 whatever the manipulations of the head 18 of the fly.

 Obviously, any other form of brake can be adopted without departing from the scope of the present invention.

 Figure 1 shows several adhesive pads 36 which allow the user to choose the location of the fly, so as to ensure interchangeability of the location of the fly.

 The hexagonal shape of the patch 36 also allows the user, depending on its position relative to the display device, to quickly choose the position of the fly from three axes at 60 angular degrees. It thus easily increases the comfort of use of the fly without disturbing the precision of the manipulations.

The tablets will, for example, be fixed by the user so that one of the three axes of the tablet 36 is parallel to a normal observation axis.

 As shown in Figure 4 in top view and Figure 5 in side view and in section, the head 18 of the fly control member 14 is extended by a shaft-shaped tail 16 penetrating into the body 20, so as to drive a parallelepiped 40 enclosed in the body 20. This parallelepiped 40 is immobilized in rotation, for example by four side plates 50. It is also immobilized in translation in the longitudinal axis of the tail 16 by means not shown in the Figures. A bore 42 is formed in the parallelepiped 40 parallel to the longitudinal axis, the shank 16 penetrating this bore to drive the parallelepiped 40 in translation in the two perpendicular axes 24 (Figure 2) of the plane perpendicular to the longitudinal axis of the tail 16. The tail 16 is capable of sliding and turning in this bore 42.

 The parallelepiped 40 is returned to the median rest position in the two perpendicular axes 24 by elastic means constituted, for example, by springs 48 resting respectively, on the one hand, on a wall or equivalent of the body 20 and, on the other hand, on a corresponding plate 50. Preferably, each plate 50 is made movable only in translation parallel to the corresponding wall of the body 20, for example by means of at least one telescopic rod 46. The tail 16 can also be returned to the median rest position in the longitudinal axis by completely equivalent means.

 Detectors 44 (FIG. 4) make it possible to detect the precise position of the parallelepiped 40 and of the tail 16. Preferably, these detectors 44 are of analog type, and determine a coded signal applied, via an interface, to the machine. A possible coding consists in treating the signal as an optical signal, the three primary colors - red, blue and green - determining spatial coordinates, while the intensity or frequency of the optical signal determines a time component or a component in fuzzy logic.

 We will now explain some applications of the fly according to the invention with reference to Figures 6 to 8.

 FIG. 6 represents an example of display screen 4 of a machine of the personal computer type supporting a software tool known from the prior art. A window 70 occupies part of this screen 4. A first control area 60, 62 is provided in the upper part of the window 70 on either side of a title area 58. A movable cursor 56, controlled by the user by means of a pointing device, can reach all the image elements of the screen 4. By placing the cursor 56 on a control area 60, 62, and by validating the position, the user can act to determine a larger or smaller window, or even exit the current window. A second control area 64, 66, 68 is provided on the right vertical part of the window 70 and constitutes what is called an elevator allowing, always by means of the mobile cursor 56, to move the image in the window 70 towards up or down depending on the position of the cursor 56. Finally, there is a plurality of icons or dtideograoes 54 which allow the user to choose, still by means of the mobile cursor 56, other windows coming virtually superimpose on window 70 which then becomes a main window. It can therefore be seen that the user must, for his dialogue with the machine, move the cursor 56 over the entire screen, which quickly becomes a tedious and relatively time-consuming operation compared to the internal operating speed of the machine. In addition, the more there are action zones on the screen, the smaller these must be, which results in very precise positioning of the mobile cursor 56, and increased visual fatigue for the user.

 With the device of the invention, the fly, a manipulation of the head of the fly, for example a translation in one of the two axes 24 (Figure 2) of the plane perpendicular to the longitudinal axis of the head, can determine a corresponding evolution of the image on the screen 4. As a result, certain control zones, such as the second zone 64, 66, 68, forming an elevator, become unnecessary, which makes it possible to obtain a window having a useful surface more important and a software optimization by eliminating the management of the areas thus eliminated, and avoids the user an intensive use of the pointing device. It is thus seen, Figure 7, that the window 74 can be easily compared to the screen 4 by a slight translation of the head of the fly, then be moved or selected with the pointing device before validation to become in turn the main window.

 A translation of the head of the fly parallel to its longitudinal axis (arrow 26, Figure 2) can determine either a corresponding evolution in depth of the window on the screen (zoom), or a binary decision by validation-invalidation at the way of the keys generally provided on the pointing device.

 A rotation of the head around its longitudinal axis determines either a corresponding rotation of the image or part of the image on the display device, or an evolution of the image or part thereof, or a fine configuration of a selection criterion in fuzzy logic, configuration which was previously carried out by moving the cursor in an elevator-type control zone.

 Thus, it is easy to obtain an image of the type of that represented in FIG. 8, in which windows 76, 78, 80, 82 are virtually stacked, but remain visible by means of a displacement of the center of vision, as if the user himself even had moved into space.

 Another example, a translation of the head of the fly in its longitudinal axis could validate a binary decision and a rotation of the head could allow a complementary choice in fuzzy logic which will itself be later validated by a new translation of the head of the fly. We can use the expressions 'to blow positively' and 'to blow negatively' respectively for the validation and the invalidation during a binary decision making.

 Obviously, the precise function of each of the possible manipulations of the fly head will be determined by the current software application.

 Depending on the memory capacity of the machine, the fly may benefit from a memory cache to memorize the last operations of the user. The fly then allows a backtrack in two possible modes: (i) a back reading of the image, and (ii) a invalidation making it possible to return to a previous decision. In the latter case, this will result in an easy and rapid reformulation for the user of the previous states of possible bad results.

It can therefore be seen that the invention which has just been described constitutes a marked improvement in the dialogue between a man and a computer type machine. Indeed, the pointing device ensures the elementary action function, while the fly makes it possible to decompose the rest of the interaction between man and machine into three distinct elementary functions, after having revealed the elementary action function provided by the pointing device
- possible evolution of the image or part thereof on the display device so as to correspond to a virtual evolution of man relative to the image or part of image generated on the display device;
- fine configuration of the selection criteria in fuzzy logic; and
- binary decision making by validation-invalidation.

 The invention does indeed constitute a method for optimizing the dialogue between man and machine, the fly which has just been described clearly implementing the aforementioned method.

 In short, the fly of the invention therefore gives the possibility of choosing the place where to place the device, thus offering possible use with two hands to achieve maximum efficiency. The fly also makes it possible to greatly reduce the visual fatigue of the user and to improve at the same time the visualization by a substantial increase in the effective surface of the screen. In addition, the fly brings an increased efficiency by dissociating the visualization of the action and the corresponding decision by a significant cerebral lateralization, and by taking into account human factors. Finally, speed and precision of the settings are increased thanks to a more realistic analogy with the real means of setting.

 This ensures easy movement in a two or three dimensional computer world to make multiple operations (including multi-user) to reflect, for example, reality with the view of a robot, which allows to control or operate an item remotely.

 Although we have represented and described what are currently considered to be the preferred embodiments of the present invention, it is obvious that the Home of the Art can make various changes and modifications without departing from the scope of the present invention.

In particular, the fly described may be produced by virtual means, for example for the automatic control of robots, or may be provided with real means to be manipulated by foot or by voice. In addition, the multiple possibilities of possible combinations make it possible to obtain specific software tools to be developed.

Claims (15)

 1 - Optimization method for a dialogue between a man and a computer type machine including a calculator (6), a display device (2, 4) in a current software application capable of managing a virtual image of size greater than that generated on said display device, and a pointing device (8), characterized in that the execution of the elementary action function is left to the pointing device and three distinct elementary functions are executed  - possible evolution of the image or part thereof on the display device so as to correspond to a virtual evolution of said man with respect to the image or part of the image generated on said display device;  - fine configuration of the selection criteria in fuzzy logic; and  - binary decision making by validation-invalidation.  2 - Computer peripheral for optimizing the dialogue between a man and a machine for the implementation of the method according to claim 1, characterized in that it comprises a head (18) having a longitudinal axis, said head (18) being movable in translation in said longitudinal axis and in two axes perpendicular to a plane perpendicular to said longitudinal axis, and movable in rotation about said longitudinal axis, the position of said head relative to its rest position determining the stages of said process.  3 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 2, characterized in that the translation of said head (18) in said plane perpendicular to its longitudinal axis determines the corresponding evolution of l image or part of the image on the display device.  4 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 2 or 3, characterized in that the translation of said head (18) in its longitudinal axis determines either a corresponding change in depth of the image on the display device, that is to say a binary decision by validation-invalidation, according to the current software application.  5 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 2 to 4, characterized in that the rotation of said head (18) around its longitudinal axis determines either a corresponding rotation of the image on the display device, either an evolution of the image, or a fine configuration of the selection criteria in fuzzy logic, depending on the current software application.  6 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 2 to 5, characterized in that said head (18) is mounted on a body (20) including a plurality of detectors of the position of said head, said detectors being coupled to said machine via an interface.  7 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 6, characterized in that said detectors are of analog type.  8 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 6 or 7, characterized in that said head (18) is returned to a median rest position by elastic means (48) enclosed in said body.  9 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 6 to 8 characterized in that said head (18) is extended by a tail (16) penetrating into the said body (20) and capable of causing a parallelepiped (40) enclosed in said body (20).  10 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 9 characterized in that said parallelepiped (40) is immobilized in rotation and in translation in said longitudinal axis and is pierced with a bore ( 42) substantially parallel to said longitudinal axis, said tail (16) penetrating said bore (42) to drive said parallelepiped (40) in translation in said two axes perpendicular to a plane perpendicular to said longitudinal axis and being capable of sliding and turning in said bore (42).  11 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 2 to 10, characterized in that said head (18) is intended to be manipulated by the hand of the man dialoguing with said machine, hand left free for possible use of said pointing device (8).  12 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 6 to 11, characterized in that said body (20) is provided with a brake means such as manipulation of said head (18) does not cause a material displacement of said peripheral.  13 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 12, characterized in that said brake means is constituted by an imprint (32, 34) which can accommodate an adhesive pad (36) fixed by elsewhere.  14 - Computer peripheral for optimizing the dialogue between a man and a machine according to any one of claims 2 to 11 characterized in that it is physically integrated with another peripheral of the said machine.  15 - Computer peripheral for optimizing the dialogue between a man and a machine according to claim 14 characterized in that said other peripheral is chosen from the group comprising a pointing device (8), a screen (2) and a keyboard (12).