WO2013153338A1

WO2013153338A1 - Improved command generation in a touch-screen device

Info

Publication number: WO2013153338A1
Application number: PCT/FR2013/050794
Authority: WO
Inventors: Marcos SERRANO; Eric LECOLINET
Original assignee: Institut Mines Telecom
Priority date: 2012-04-12
Filing date: 2013-04-11
Publication date: 2013-10-17
Also published as: FR2989484A1

Abstract

The invention relates to command generation in a device comprising a touch screen. Advantageously, the device is also provided with at least one sensor (TAP) that is sensitive to the user tapping an area at the edge of the screen (Z2), wherein the method comprises the following steps: consecutively detecting a first tap and a second tap, the at least first and second taps being detected in the area at the edge of the screen (Z2); estimating a time between detecting the first and second taps; and deciding to execute a predetermined command if the estimated time is shorter than a selected threshold time.

Description

Improved order generation in touch screen equipment

The present invention relates to the generation of commands in equipment comprising a touch screen, such as for example mobile telecommunication terminals (smart-phones, for example), or tablets, or other.

In such equipment, it is often proposed a single human / machine interface through a simple touch screen. However, commands that can be generated from a simple interaction with a touch screen remain limited.

It is currently sought to increase the number of commands that can be generated as part of such an interface.

The present invention improves the situation.

It proposes for this purpose a control method of a device comprising a touch screen, in which there is further provided a sensor responsive to a support by a user on a screen edge area. The process then comprises the steps:

detecting successively a first support and a second support, at least one of the first and second supports being detected in a screen edge zone,

estimating a duration between the detections of the first and second supports, and decision to execute a predetermined command if the estimated duration is less than a threshold duration, chosen.

"Touch screen" means a display screen provided on its surface with a device for detecting contact with a finger, a stylus or the like, which presses on the surface of the screen at a given point . The touch screen may comprise a capacitive slab, or infrared transmitters / sensors, or others. Often, such devices can accurately determine the coordinates of the point of contact on the surface of the screen. By "screen edge area" is meant, on the other hand, a termination area of the screen, for example the border flanking the screen. It can then be an area of the screen not covered by the device for detecting touch inputs. Thus, pressing the "screen edge area" is not detected by the touch screen in this case.

Thus, in an embodiment where the touch screen is sensitive to a support on a screen area and insensitive to a support on a screen edge area, the detection of a support in an edge area of screen is characterized by the detection of a support by the aforementioned sensor, and no detection of support by the touch screen, while the detection of a support in a screen area is characterized by the detection of a support by the touch screen, at least.

"Support" is understood to mean touching, touching, touching, tapping or striking, carried out by a user's finger or caused by a stylus (or other) handled by the user.

Thus, the aforementioned sensor, "sensitive to a support by a user on a screen edge area", is able to detect a support in an area that is out of detection by the touch screen. It may be for example a capacitive sensor arranged on the edge of the equipment (for example on the side edge of a mobile telecommunications equipment type smart-phone or tablet), or, according to a mode embodiment described below, an acceleration sensor responsive to a support not detected by the touch screen.

The invention then proposes:

to combine the two detections (by the touch screen, on the one hand, and by the aforementioned sensor, on the other hand) to trigger a chosen action if the two detections take place in a predetermined time interval,

or else to trigger a particular action if two detections by the sensor only are performed in a predetermined time interval. The term "threshold time" above then means such a predetermined time interval, which for example may be of the order of a few hundred milliseconds (for example between 200 ms and 600 ms).

The command that is generated, following this double detection, can be for example an unlocking of the equipment, or access to particular shortcuts in a menu, or other, according to various possible embodiments, described below.

It will be understood in general that doubling the different types of detection makes the detection technique more robust: the detection is not triggered by chance or by mistake. It also allows to multiply advantageously the number of possible commands, compared to what usually offers a simple touch screen. This goal is achieved by simply adding a sensor which, in the case for example of an acceleration sensor, has a very low cost of implementation and implementation.

In one embodiment, the aforementioned predetermined command comprises an unlocking of the equipment. In an exemplary possible implementation of this embodiment, the first and second aforementioned supports are detected in a screen edge area. For example here, the user can press twice in succession, sufficiently close in time, on the edge of the screen and / or on the edge of the equipment, to cause the unlocking of the equipment. For example, in many known smart phones, this unlocking function is usually caused by a slide of the finger (after turning on the screen by pressing a physical button).

In another embodiment, the second support is detected in the screen area and a position of the second support on the touch screen area is determined to initiate an application corresponding to this detected position of the second touch on the touch screen. It should be noted here that the terms "first and second support" do not necessarily characterize a sequence in time of the first and second support. In this embodiment, the "second" support simply characterizes a support on the touch screen area, and may intervene possibly before the first support, the essential thing being that the first and second supports are spaced in time by the duration threshold mentioned above.

However, in a possible embodiment, it is advantageous that the first support is the first detected in time and more particularly, the first support (in the screen edge area) causes a display of one-page icons. the second press on one of these icons causes the execution of an application corresponding to the selected icon. Thus, chaining a support at the edge of the screen with a touch on the screen can generate a new command, such as the execution of a shortcut specific to a user of the equipment.

In one possible embodiment, the screen being rectangular, screen corner icons, at least, are displayed after the first support and correspond to custom shortcuts to predetermined applications. Advantageously, the user having only a few hundred milliseconds to choose the icon to activate can direct his eyes directly to the corners of the screen to activate a chosen icon.

Furthermore, in addition or alternatively, the aforementioned sensor may be sensitive to a support near a particular corner of the screen. Thus, if the first support is detected near this particular corner, it may be displayed for example icons near this particular corner, according to a preferred configuration of a user of the equipment. Another user can define another corner of the screen to display preferentially icons that he has chosen.

As indicated above, the aforementioned sensor may comprise an accelerometer, which is advantageous in terms of the cost of designing an equipment in the sense of the invention. If it is furthermore desired to detect screen edge supports in different edge regions or corners of the screen as indicated above, it may advantageously be provided with at least two acceleration sensors arranged at distinct corners of the screen. 'screen. Optionally, it can be provided for example four acceleration sensors arranged at the four corners of the screen as will be seen in an exemplary embodiment detailed below.

The present invention also relates to a control module of a device comprising a touch screen and at least one sensor sensitive to a support by a user on a screen edge area. In particular, the module comprising:

a unit for receiving and processing signals coming from the touch screen and the sensor, to identify successive detections of a first support and a second support, at least one of the first and second supports being detected in a screen edge area,

a clock for estimating a duration between the detections of the first and second supports,

a circuit for comparing the estimated duration with a chosen threshold duration, and

an output for delivering a predetermined control signal, if the estimated duration is less than said threshold duration.

The present invention also provides equipment comprising a touch screen, a sensor responsive to a support by a user on a screen edge area, and a control module of the aforementioned type.

As soon as the control module can be judiciously programmed to execute the method defined above, the present invention also relates to a computer program comprising instructions for the implementation of this method, when this program is executed by a processor, particularly the processor. processor of a control module within the meaning of the invention. Other advantages and characteristics of the invention will appear on reading the following detailed description of nonlimiting exemplary embodiments, and on examining the appended drawings in which:

- Figure 1 schematically illustrates an equipment within the meaning of the invention;

- Figure 2 illustrates a comparison of the signals from a touch screen and a sensor of an equipment within the meaning of the invention;

FIG. 3 schematically illustrates the steps of an exemplary embodiment of the method in the sense of the invention, corresponding then to a flow diagram of a general algorithm of a computer program within the meaning of the invention;

- Figure 4 details an embodiment of a control module of an equipment within the meaning of the invention;

- Figure 5 shows in more detail the provision of additional sensors to a touch screen, in equipment within the meaning of the invention;

- Figure 6 illustrates possible support areas, outside the touch screen;

- Figure 7 shows the signals along three axes x, y and z, from an acceleration sensor C of the type shown in Figure 1, in particular;

FIG. 8A illustrates a support on a screen edge area, while FIG. 8B illustrates, in an exemplary embodiment, a consecutive display of icons associated with the support represented in FIG. 8A.

With reference to FIG. 1, equipment within the meaning of the invention comprises at least one touch screen ECR, as well as a sensor C (for example an acceleration sensor), both connected to a control module MOD of the invention. 'equipment. Depending on the signals received by the MOD module, it is delivered a particular command COM, as will be seen in the embodiments described below. In particular, it will be noted in FIG. 1 that the MOD module receives two types of signals:

- one that delivers the touch screen, and

the other that delivers another sensor, for example an acceleration sensor C.

Referring now to FIG. 2, the signal coming from the touch screen SE (presented here very schematically and for a didactic purpose) presents, in the example represented, a variation of intensity at a time t ₂ , while the signal delivered by the sensor is at a time ti (here before t ₂ ) a strong intensity variation. MOD control module is arranged then to detect whether the difference Dt, between the instants ti and t ₂ is less than a threshold T to _0, if appropriate, trigger a suitable control. In a variant, if the module MOD consecutively receives two strong signal variations from the sensor Se, while the signal coming from the touch screen S _E has no variation (dashed lines of the signal S _E , illustrated in FIG. 2) , then the control module MOD can issue another command, as will be seen hereinafter with reference now to FIG.

In an exemplary embodiment, a first test T1 is performed to determine whether a signal is received from the sensor C. In practice, the signal from the sensor is sampled at a chosen frequency and if a strong variation of the signal is detected (beyond of one or more successive thresholds, as illustrated by way of example in FIG. 7), the module MOD declares the detection of a support by the sensor C. If this is indeed the case (arrow ok at the output of the test Tl ), it is sought to determine if the signal Se has a second strong intensity variation on the T2 test, in a time interval less than the threshold duration T ₀ (at the T3 test). If this is the case (ok arrow at the output of the test T2), the control module MOD delivers a first command in step S5 (referenced COM1 in FIG. 3). This first command may correspond for example to an unlocking of the equipment. Thus, two successive taps on the edge of the screen (not detected by the touch screen) trigger the unlocking of the equipment, in an exemplary embodiment possible.

In an exemplary embodiment where other commands can be generated by a double detection by the sensor C, on the one hand, and by the touch screen ECR, on the other hand, it can be provided an intermediate test T4 to verify if a signal variation is measured at the output of the touch screen. In particular, if the time difference between the instants t ₁ and t ₂ of FIG. 2 remains lower than the threshold duration T ₀ , the control module MOD delivers a second possible command COM 2 at step S 6. This second command can be for example the launch of an application corresponding to a icon on which the user pressed in the screen area and therefore identified by the ECR touch screen, as will be seen later with reference to Figure 8B. A short time delay (a few tens of milliseconds) can be implemented in the event of success on the Tl test (OK arrow at the output of the Tl test) and before the T4 test, so as not to trigger the step S6 if it is detected simultaneously. a support by the touch screen and the sensor C (which is likely to occur with an acceleration sensor C if the user taps on the touch screen, as shown in Figure 2 at time t ₂ ). In a variant, it is also possible to calibrate the thresholds of variation of the signal Se to validate the detection by the sensor C if the variations of the signal exceed these thresholds.

To implement the method illustrated in FIG. 3, the MOD control module comprises, with reference now to FIG. 4, at least one URT unit for receiving and processing the signals coming from the sensor Se and originating from the touch screen. S _E. This unit URT identifies strong variations in intensity of the signal Se and can further determine an exact position of support on the touch screen from the signal S _E. This unit URT can thus determine the time difference Dt illustrated in FIG. 2, with reference to a clock HOR (for example the clock of a processor). The module MOD also typically comprises a processor PROC, as well as a working memory MEM, for comparing the elapsed time Dt with the predetermined threshold duration T ₀ , then performing the test T3 of FIG. 3 and delivering (if the duration Measured dt is less than the threshold duration) a suitable command COM, by an output SOR which furthermore comprises the module MOD.

Referring now to Figure 5, the equipment comprises a screen area represented by hatching and referenced ZI. The touch screen ECR is then touch sensitive in this zone ZI. On the other hand, the edges of this zone, referenced Z2, are external to the detection zone by the touch screen and a support in this zone Z2 is not detected by the touch screen. On the other hand, this support can be detected by at least one of the sensors C1, C2, C3 and C4 that the equipment in this embodiment comprises (for example acceleration sensors). The equipment further comprises other devices, for example a microphone, a camera, and the like, forming RI and R2 visual cues for a user, when the screen is off. Thus, with reference to FIG. 6, when the user presses a first time at a TAP point (for example in the form of a tape) in the screen edge zone Z2, the module MOD detects no particular variation signal in the ZI zone. However, the sensors C1 to C4 deliver signals with variations in intensity, with in particular a greater variation for the sensors C3 and C4, in the example of FIGS. 5 and 6. FIG. acceleration signals that can be measured by one of the sensors C1 to C4, along the three axes x, y and z of FIG. 6. In an exemplary embodiment, these signals are sampled at a frequency of 100 Hz (a sample every 10 ms). With the aid of four acceleration sensors, it is possible to determine, for example, eight distinct positions of support on the edge zone Z2, as illustrated in FIG. 6. However, the arrangement of two acceleration sensors only at two corners of the Z2 screen edge area also made it possible to obtain satisfactory results.

Thus, with reference now to FIG. 8A, the user, with the help of the visual references R 1 and R 2, can type with his finger a selected region (center, edge or corner) in the edge zone. Z2 screen, which generates with reference to Figure 8B an icon display (bearing the references Tap 0 to Tap 15), with the most relevant icon for example (Tap 10) being displayed near his finger . Thus, in this embodiment, the MOD module is able to detect a point where the user has typed with his finger on the edge area of the screen Z2 and accordingly display the most relevant icons near his finger (eg personal shortcuts of the equipment user, or most-launched application icons, or favorites icons, or others).

Of course, other achievements are possible. For example, the user, using the visual references RI and R2, can tap one of the corners of the equipment with his finger, so that the MOD control module recognizes the user by the corner on which he typed. Then, the MOD module controls the display of icons of a custom desktop for this user (with icons specific to this user). Then, if another user taps on another corner of the equipment, other icons (specific to that other user) appear, and so on.

Multiple other applications are possible, since it is possible to combine two detection modes, one by a conventional touch screen, and the other by a support sensor in a screen edge area (no detectable by the touch screen).

Of course, the present invention is not limited to the embodiment described above by way of example; it extends to other variants.

Thus, there is shown very schematically and didactically the signal from the touch screen S _E of Figure 2. In reality, the signal from the touch screen is much more complex. It gives both support information on the touch screen, moment of support, and support coordinates. The same goes for the signal coming from the sensors C1 to C4, since they can give, by triangulation, both the moment of support and the coordinates of the support in the edge zone of screen Z2 .

The chosen threshold duration T ₀ may be of the order of a few hundred milliseconds as indicated above (for example between 200 and 600 ms). It can also be adjusted by the user himself for example in a user preferences setting menu.

Finally, the invention is not limited to a particular embodiment of a command that can trigger the module based on the detections it performs. It may in fact be provided various orders that are generated however according to two criteria:

detection by a sensor (for example acceleration), without any detection by the touch screen; and

a second detection (by the sensor and / or the touch screen),

the two detections being measured at a time interval less than the aforementioned threshold duration T ₀ .

Claims

A method of controlling a device comprising a touch screen, in which there is further provided a sensor responsive to a support by a user on a screen edge area, the method comprising the steps of:

detections (T1, T2, T1, T4) successively of a first support and a second support, at least one of the first and second supports being detected in a screen edge zone,

estimating a duration (Dt) between the detections of the first and second bearings, and

decision to execute a predetermined command if the estimated duration is less than a threshold duration (T ₀ ), chosen.

2. The method of claim 1, wherein the predetermined command (COM1) comprises an unlocking of the equipment.

The method of claim 2, wherein the first and second supports are detected in a screen edge area (72).

4. Method according to one of claims 1 and 2, wherein the second support is detected in a screen area (ZI) and a position of the second support on the touch screen area is determined to launch (COM2) a application corresponding to said position of the second support on the touch screen.

5. Method according to claim 4, wherein the first support causes a display of icons of a home page (Tap 0, Tap 15) and the second press on one of said icons causes the execution of a application corresponding to the selected icon (Tap 10).

The method of claim 5, wherein, the screen being rectangular, at least screen corner icons correspond to custom shortcuts to predetermined applications.

7. Method according to one of the preceding claims, wherein the chosen threshold time is between 200 and 600 milliseconds.

8. Method according to one of the preceding claims, wherein,

the touch screen (ECR) being sensitive to pressing on a screen area (ZI) and insensitive to pressing on a screen edge area (Z2),

the detection of a support in a screen edge area (Z2) is characterized by the detection (T1, T2) of a support by the sensor, and no detection of support by the touch screen,

and the detection of a support in a screen area (ZI) is characterized by the detection (T4) of a support at least by the touch screen.

9. Method according to one of the preceding claims, wherein said sensor comprises an accelerometer (C).

10. The method of claim 9, wherein, the screen being rectangular, there is provided at least two acceleration sensors arranged at distinct corners of the screen (C1, C2, C3, C4).

11. Control module of a device comprising a touch screen and at least one sensor sensitive to a support by a user on a screen edge area,

the module comprising:

- A reception and processing unit (URT) of signals from the touch screen and the sensor, to identify successive detections of a first support and a second support, at least one of the first and second supports being detected in a screen edge area, a clock (HOR) for estimating a duration between the detections of the first and second supports,

a circuit (PROC, MEM) for comparing the estimated duration with a chosen threshold duration, and

an output (SOR) for delivering a predetermined control signal, if the estimated duration is less than said threshold duration.

12. Equipment comprising a touch screen (ECR), a sensor (C) responsive to a support by a user on a screen edge area, and a control module (MOD) according to claim 11.

13. Computer program comprising instructions for implementing the method according to one of claims 1 to 10, when the program is executed by a processor (PROC).