WO2017001578A1

WO2017001578A1 - Virtual remote control

Info

Publication number: WO2017001578A1
Application number: PCT/EP2016/065339
Authority: WO
Inventors: David SOUHAMI
Original assignee: Softathome
Priority date: 2015-06-30
Filing date: 2016-06-30
Publication date: 2017-01-05
Also published as: EP3317868B1; EP3317868A1; FR3038436A1; ES2777536T3; PL3317868T3; FR3038436B1

Abstract

The invention relates to a portable electronic device used as a remote control for a remote appliance, the device comprising a touch-sensitive surface and a processing unit housing a software application which, when it is run, virtually subdivides the touch-screen surface into only three active zones and detects actions performed on these zones so as to generate control signals for the remote appliance; the three zones being constituted by: - two so-called support zones each located at one of the two opposite ends of the surface, each support zone being designed to form in its entirety a single punctual control zone, and - a central zone larger than each of the support zones, this central zone being designed for detecting gestures.

Description

"Virtual Remote Control."

Introduction

The present invention relates to a portable electronic device used as a remote control of a remote device such as a TV set-top box connected to a TV.

The interaction between a user and the television is based on the traditional use of a remote control to control the desired actions such as zapping, switching to standby, access to the program guide, configuration, etc. ..

The user adapts to his remote control whose number of keys is variable according to the ergonomics associated with the TV interface. The way to use the keys on this remote control, their actions are all predefined things by the provider of the TV screen, Set Top Box or other device controlling the display on the TV screen.

Prior art

There are two extremes: remote controls where a key is associated with a function (EPG, VOD, selection of the source, ...), remote controls where a combination of several supports is necessary to access a function. In the first case, the user must look carefully at his remote control to read the functions to launch, in the latter case, the Human Machine Interface is decisive to minimize the number of key presses to allow access to services.

The existence of new mobile screens such as tablets, smartphones, new objects such as touchscreen mice, now leads to consider two categories of remote controls: the physical remote control as an object that is taken in hand with physical buttons , and the virtual remote control, as an application running on a third-party screen, or a touch-screen object.

The virtual remote controls developed so far are systematically seeking to reproduce the physical remote controls. They therefore require a screen, and represent the buttons of a conventional remote control. A screen with no physical buttons, it is always necessary to look at the screen of the remote control virtual to determine where the desired button is, then look at the screen that is checked to ensure the result, and then look again at the screen of the remote control and so on. This makes the use of this remote difficult for the duration.

Moreover, when the user wants to reproduce the atmosphere of a movie theater, he puts the room in which it is installed in the dark so as to be completely absorbed by the screen. In such a case, the conventional remote control is not visible and the virtual remote control requires a backlight to be visible, so a significant consumption of energy.

The present invention relates to a virtual remote control that can be used without necessarily visually check where we support.

The present invention also relates to a virtual remote control capable of operating on a touch object without a screen.

Another object of the invention is a virtual remote control that can be used in the dark.

Presentation of the invention

At least one of the above-mentioned objectives is achieved with a portable electronic device used as a remote control for remote equipment such as a television set-top-box connected to a television set. This device comprises a touch-sensitive surface and a processing unit housing a software application which, when executed, virtually cleaves the touch-sensitive surface into only three active zones and detects the actions performed on these zones so as to generate control signals towards the equipment. distant; the three zones being constituted by:

two zones called support zones located respectively at the two opposite ends of the surface, each support zone being configured to constitute in its entirety a single point-controlled zone, and

a central zone of greater size than each of said support zones, this central zone being configured for the detection of gestures.

With the device according to the invention, instead of reproducing a traditional physical remote control reproducing graphic objects representing buttons, we use here the principles of touch, especially on large areas, to send commands remotely, so never need to look at the control object to control what happens on the remote equipment.

The arrangement of the zones according to the invention allows a user to easily place the finger on the desired area without looking at the tactile surface. Overall, it is easy to mechanically identify the upper part, the lower part and the central part of a tactile surface. The device of the invention allows to reconsider the principle of a remote control, using touch areas rather than buttons, associated with gestures. To do this, it can be a mobile phone type "smartphone", a tablet or a touch mouse, a touchpad or any other device having a touch surface and a processing unit (detection, filtering, recognition, conversion, ...) capable of processing actions performed on the touch surface. The processing unit is therefore configured to perform a correspondence between, on the one hand, predefined and parameterized gestures in the software application and, on the other hand, control signals understandable by the remote equipment. Simple gestures can be defined, each gesture being associated with a control function of the television. The software application can integrate several mapping tables between the gestures and a set of commands for each TV manufacturer.

The support zones according to the invention are designed to receive the thumb of the user. Their arrangement at the ends of the touch surface allows an easy and error-free use. For example, a touch zone can be set to increment channels of the TV, while the other touch zone can be set to decrement. Preferably, the processing unit is configured to process only point actions, that is to say short or long supports for generating a command increase or decrease of one or more arbitrary units.

The central zone is able to receive instructions in the form of gestures made by a finger or several fingers of a user. The central zone is wide enough for the user to realize his gestures without having to observe the tactile surface. The three-zone division of the tactile surface with two support zones at the end is particularly judicious because these three zones, two for one-off commands and one for gestures, make it possible to address all the commands of a classic remote control without showing a multitude of active keys on the touch surface. The controls can be made without looking at the touch surface.

According to an advantageous characteristic of the invention, the tactile surface may be a touch screen, for example as that of a mobile phone type "smartphone" or a tablet.

With the device according to the invention, one transforms the support actions on keys perfectly calibrated to the size of a finger, on a conventional remote control in particular, in local gestures to have the same remote actions. These gestures must make it possible to keep one's eyes fixed only on a screen, the one that one controls.

In order to ensure that a control signal has been generated by the device, there is for example a sound unit able to be activated in response to the generation of a control signal to the remote equipment. In this way, an audible signal warns the user when a support has been validated on one of the two support zones or when a gesture has been made on the central zone.

In the same way, the device according to the invention may comprise a vibratory unit capable of being activated in response to the generation of a control signal to the remote equipment. Thus, the device vibrates in the event of a command validated on the touch surface. The vibratory mode can be combined with the sound mode.

In addition, the device according to the invention may comprise a visual unit capable of being activated in response to the generation of a control signal to the remote equipment. The visual unit may advantageously be the screen of the device which may be in unlit mode except when a command (a support or gesture) has been validated by the processing unit. In the lit mode, the screen can be illuminated on the whole surface or simply on the part concerned by the identified control: that is to say on the central part when a gesture has been identified in this central zone, on the one of the support zones when support has been identified in the area concerned. Lighting can take a long time or be repetitive.

As a variant, the screen of the device may be in illuminated mode when performing gestures or support. In this case, the validation of an order can be done by blinking all or part of the screen.

In addition to the above, we can consider a visual feedback, together or not with the illumination of the screen, on a diode disposed on the device.

According to an advantageous characteristic of the invention, the device according to the invention may comprise at least one transmitter for wireless transmission of the control signals with the remote equipment.

Preferably, it is a transceiver for bidirectional wireless communication of the control signals with the remote equipment. In this case, the remote equipment also includes directional communications means. It can further be envisaged that an acknowledgment is sent by the remote equipment when an order has been correctly received by the latter.

According to one embodiment of the invention, when the device is held vertically, the two support zones are located on the upper part and the lower part respectively. The two support zones are sufficiently far apart for the user to make no mistake between them. The one at the top can correspond to an incrementation. The one at the bottom can correspond to a decrementation.

Preferably, when the tactile surface has a parallelepipedal shape, each bearing zone is a strip along the entire length of the side where it is located.

Moreover, it can be envisaged that at each corner of the tactile surface, the bearing zone has a length greater than that of the region between the two corners of the same side of the touch surface. In this way, the thumb can more easily reach the support areas.

Description of figures

Other features and advantages of the invention will appear on reading the detailed description of implementations and modes of in no way limiting, with reference to appended figures in which:

- Figure 1 is a schematic view of a system comprising a device such as a smartphone as a remote control for a remote device such as a digital decoder or a television according to the invention;

- Figure 2 is a schematic view of a virtual cutting of a touch surface or a touch screen according to the invention;

FIG. 3 is a very simplified schematic view of a constituent component part of a device according to the invention; and

- Figure 4 is a simplified flow chart of the steps for generating a control signal according to the invention.

Description of the invention

The described embodiments being in no way limiting, it will be possible in particular to make variants of the invention comprising only a selection of characteristics described hereinafter, as described or generalized, isolated from the other characteristics described, if this selection of characteristics is sufficient to confer a technical advantage or to differentiate the invention from the state of the art.

Figure 1 illustrates a system 1 according to an embodiment of the invention. The system 1 comprises:

a remote device 2, here a set-top box or English set-top box;

a portable control device 3, here a "smartphone"; and

- TV 4

The set-top box 2 transmits to the television 4 one or more video streams such as television channels to be viewed.

Usually the generated signals are transported between the set-top box 2 and the TV 4 via an HDMI cable 5.

In the example shown, the set-top box 2 further comprises a BLE signal transmitter (not shown). The smartphone 3 also comprises a BLE signal transmitter and can thus be in communication with a wireless link L with the set-top box 2.

In the example shown, the smartphone 3 is used as a remote control of the set-top box 2, a remote control which therefore has the function of controlling the changes of channels, the variation of the volume, the navigation in various menus, the controls of a video playback ... But the present invention can also be implemented using the smartphone as a TV remote only or possibly both devices.

According to the invention, the touch screen or touch surface 8 of the smartphone 3 will be used as input interface commands of the remote equipment. With the help of his finger, the user will make gestures and presses on the touch screen 8. Unlike the prior art, the user does not press on graphic objects symbolizing the keys of a remote control classic. It is no longer a simple emulation or software reproduction of a conventional remote control but a new design, a new interpretation of the remote control. An example of common use of the buttons of a conventional remote control is as follows:

Long

Short Validation

οκ

Long

Numbers to jump

0 1 ... 9 Short directly to a specific channel

Short Navigation Arrows

Long Scroll Fast

Reading actions of a

"\" "!! ■ · ► Short

video content

The present invention is intended in particular to reconsider the principle of a remote control, using tactile areas rather than buttons, these touch zones being associated with gestures, and using returns by vibration and / or sound ensuring good grip account of the action, to cover most of the desired actions.

In order to allow the use of a remote control without having to visually check if the correct key is actuated, the present invention proposes to use a touch-sensitive surface such as the touch screen 8 of the smartphone 3 and to cut it virtually. in three areas. It can be a partition, that is to say only three zones or there may be other functional areas or not. Ideally it is only three areas with visible separation (by luminous separation lines) or not.

In FIG. 2, vertical division into three distinct zones can be distinguished with the following assignment of functions:

Zone 1: P +

Zone 2: Touch gesture control area

Zone 3: P-

The zonel is a bearing zone generally forming a band on the upper part of the tactile surface. By way of non-limiting example, this band may represent between 5 and 20% of the total area. The user who wishes to order the passage to a chain superior to the chain current, use his thumb to click on this zonel. A short press ideally corresponds to the increment of a unit while a long press can correspond to an incremental scrolling of the chains. To facilitate access to the zonel while maintaining a maximum area for the central zone, the zonel overflows on the lower surface at the corners. On each lateral end of the zonel, close to a corner of the tactile surface, a right chamfer 6 is made. Different shapes of the right chamfer can be provided, in particular rounded shapes or right angles or other angles. In the end, the zonel is in the shape of a straight band at the center, terminated at each end by a wider area facilitating access by the thumb. Both ends are so arranged that the device is compatible for left-handed and right-handed users.

Zone3 is also a zone of support similar to the zonel but situated at the bottom of the tactile surface, at the lower end when the tactile surface is held vertically as shown in FIG. 2. The zonel and the zone 3 are symmetrical with respect to each other. to a horizontal axis passing in the middle of the tactile surface. The chamfers 7 make it possible to create wider zones at the ends of the strip forming the zone 3. When a user wishes to control the switch to a lower channel than the current channel broadcast on the TV for example, a short press on the zone 3 to generate a chain change control by decrementing.

The zonel and the zone3 are structured to allow to define "zones of supports" over a width without representation of a graphic object of a button limited on a small surface of the screen. These areas define the "high" and "low" areas of the screen. They are therefore accessible with the thumb, they are symmetrical to adapt to a holding in hand that one is right-handed or left-handed. They also meet the fact that the screens can have different sizes, and must adapt to the ergonomics of the hand.

These areas are only clickable areas. Sound and vibrating feedback allow the user to have a natural validation of the taking into account of the desired action, that is to say the sending to the TV of a command P + or P- (program upper / program inferior). The table below shows a set of possible actions and returns with zone zonel and zone3:

In FIG. 2, the central zone is zone 2 corresponding to the area left free by the zonel and the zone 3, generally in the center of the touch screen 8. Its shape is therefore complementary to the shapes of the bearing zones.

This zone2 provides access to a certain number of remote action commands, by simple gestures that do not require looking at the screen. These gestures can be done with the thumb for simple gestures, and with several fingers for less common actions. They all cause a remote action on the equipment that is controlled. No gesture has a local action in that is a control of the smartphone. It is possible to add following the gesture a visual, audible and / or vibratory feedback on the virtual remote control to validate the taking into account of the command. The proposed actions can:

left sliding

vertical to 1 up arrow () trace

the top

sliding

vertical to 1 Arrow down (Φ) trace

the bottom

sliding

horizontal Long arrow support

1 trace yes to the right right ( ^■ »)

and maintenance

sliding

horizontal

Long arrow support

to the 1 trace yes

left (" ^■ )

left and

retention

sliding

vertical to Long arrow support

1

the top and top (f) trace yes

sliding

vertical to Long arrow support

1 trace yes the bottom and the bottom (Φ)

retention

Short press 1 OK button

Double support

1 M ENU button

short

sliding

horizontal 2 Button (►►) trace yes

to the right

sliding

horizontal

2 Button (a) trace yes

around the

left

Short press 2 Button (M ►) yes click

Short press 3 Button (·) click yes yes

This table is very schematically a conversion table between the actions performed on the zone2 and the usual control keys of the remote equipment. The associations between gestures and control keys described above are given only as a non-limiting example. It is possible to imagine other combinations making it natural to use a touch object to control the commands sent to a television or decoder displayed on a screen. More elaborate gestures can be envisaged. Figure 3 is very schematically illustrated some constituent elements of a device according to the invention. Typically, the device according to the invention may be a smartphone 3 comprising a processing unit 9, typically a microcontroller or microprocessor associated with adequate memory spaces. This smartphone 3 includes conventional software and hardware components for its smooth operation. Among the hardware components there is in particular a power supply battery 10, a transceiver 11 for wireless communication with the remote equipment, a vibrator 12 for a vibrating feedback, the touch screen 8 for, among other things, a visual feedback, and a speaker 13 for a sound return. These elements are connected to each other in a conventional manner, in particular they are all controlled by the microprocessor.

The processing unit 9 implements a software application that performs the steps described in FIG. 4. Namely, a detection of a gesture in the zone 2 or of a support in the zone 1 or the zone 3. When a gesture or support is identified, the conversion table described above is used in particular to identify the corresponding television control. The latter is then sent to the remote TV 4 or the remote decoder 2, parallel to the generation of a validation, which can be of sound type via the speaker 13, visual mission for example a lighting via the screen 8, or vibrating via the vibrator 12.

The present invention thus facilitates the use of virtual type remote controls. It allows tactile sensations associated with a vibrator, auditory sensations acquitting the use of the device. It allows you to control a TV screen using an application running on another screen that does not include physical keys, without having to look alternately at each of these screens to find out what you are supporting and what is the result after the support.

Of course, the invention is not limited to the examples that have just been described and many adjustments can be made to these examples without departing from the scope of the invention. In addition, the various features, shapes, variants and embodiments of the invention may be associated with each other in various combinations to the extent that they are not incompatible or exclusive of each other.

Claims

1. Portable electronic device used as a remote control of a remote device, this device comprising a touch-sensitive surface and a processing unit housing a software application which, when executed, virtually cleaves the tactile surface into only three active zones and detects the actions performed. on these areas so as to generate control signals to the remote equipment; the three zones being constituted by:

2. Device according to claim 1, characterized in that it comprises a sound unit capable of being activated in response to the generation of a control signal to the remote equipment.

3. Device according to claim 1 or 2, characterized in that it comprises a vibratory unit capable of being activated in response to the generation of a control signal to the remote equipment.

4. Device according to any one of the preceding claims, characterized in that it comprises a visual unit capable of being activated in response to the generation of a control signal to the remote equipment.

5. Device according to any one of the preceding claims, characterized in that it comprises at least one transmitter for wireless transmission of the control signals with the remote equipment.

6. Device according to claim 5, characterized in that it comprises a transceiver for bidirectional wireless communication of the control signals with the remote equipment.

7. Device according to any one of the preceding claims, characterized in that the touch surface is a touch screen.

8. Device according to any one of the preceding claims, characterized in that when the device is held vertically, the two support zones are located on the upper part and the lower part respectively.

9. Device according to any one of the preceding claims, characterized in that when the tactile surface has a parallelepiped shape, each bearing zone is a strip along the entire length of the side where it is located.

10. Device according to claim 9, characterized in that at each corner of the touch surface, the bearing zone has a length greater than that of the region between the two corners of the same side of the touch surface.

11. Device according to any one of the preceding claims, characterized in that the device is a mobile phone type "smartphone".

12. Device according to any one of claims 1 to 10, characterized in that the device is a tablet.

13. Device according to any one of claims 1 to 10, characterized in that the device is a tactile mouse.

14. Device according to any one of claims 1 to 10, characterized in that the device is a touchpad.

15. Device according to any one of the preceding claims, characterized in that the processing unit is configured to perform a correspondence between on the one hand gestures predefined and parameterized in the software application and on the other hand commands understandable by the remote equipment.