EP3491488A1

EP3491488A1 - Method and system for controlling the display of information and user terminal implementing this method

Info

Publication number: EP3491488A1
Application number: EP17740016.5A
Authority: EP
Inventors: Hélène Marguerite Marie Thérèse SOUBARAS
Original assignee: Thales SA
Current assignee: Thales SA
Priority date: 2016-07-28
Filing date: 2017-07-17
Publication date: 2019-06-05
Also published as: US20190235632A1; WO2018019640A1; CN109643154A; FR3054685B1; FR3054685A1

Abstract

This method for controlling the display of at least one image on at least one screen (2) of a terminal (1) associated with means (4) for viewing a scene, is characterised in that it comprises a step of establishing a reference display configuration in which the display of the image is associated with the view of the scene output by the viewing means, and a step of detecting changes in the view of the scene output by the viewing means, in order to accordingly control changes to the display of the image on the screen.

Description

The present invention relates to a method for controlling the display of at least one image on at least one screen of an associated terminal. to means of shooting a scene.

The invention also relates to a control system, for the implementation of such a method, and to a user terminal, provided with such a control system.

The terminals of this nature the most known in the state of the art, are for example constituted by tablets, smart phones, information display monitors or computers, even connected watches, or other.

Various manufacturers and developers have already proposed methods and means for modifying the display of an image on the screen of such a terminal.

For example, it is known that it is possible to modify the enlargement / reduction factor of the display of an image on a screen or to scroll images or to change the region of interest of the image displayed on the screen. the screen.

This is for example obtained by tactile interaction between for example the user of the terminal and the screen thereof.

By way of example, a modification of the enlargement / reduction factor of the display of the image on a touch screen can be obtained for example by a user thereof, by placing two fingers on the touch screen and discarding or on the contrary by bringing them together to modify the display factor and obtain the desired display factor.

Similarly, the area of interest of an image displayed on the screen of the terminal can also be modified by a user, for example when he puts his finger on the screen and moves while still pressed on this screen, to scroll through the area of the image displayed on the screen.

An analysis of the gestures of the user by means of shooting also makes it possible to obtain such commands.

Numerous other modes of controlling such a display are also known in the state of the art. But all these known means have a number of disadvantages, particularly in terms of their implementation which requires most of the time that the user of the terminal is extremely available.

In particular, a large part of the means known in the state of the art, requires that the two hands of the user are available, so that one hand, he can hold the terminal and that the other hand, he can enter the required commands.

However, there are certain situations in which this is not possible, for example when the user is in a public transport vehicle and must stand at any holding member thereof.

The object of the invention is therefore to solve these problems by proposing various means for further simplifying this display control.

For this purpose, the subject of the invention is a method for controlling the display of at least one image on at least one screen of a terminal associated with means for shooting a scene, characterized in that it comprises a step of establishing a reference display configuration in which the display of the image is associated with the view of the scene at the exit of the shooting means and a step of detecting changes in the view of the scene at the output of the shooting means, for controlling accordingly changes in the display of the image on the screen.

According to other characteristics of the process according to the invention taken alone or in combination:

the detection step consists in detecting in addition:

a change in the view of the scene at the output of the shooting means consisting, along an axis substantially perpendicular to the plane of the screen and / or along an axis of view of the shooting means, in a translation in a direction or another from a reference position corresponding to the reference view, to modify accordingly the enlargement factor / reduction of display of the image on the screen,

a change in the view of the scene at the exit of the shooting means, in a plane substantially parallel to that of the screen and / or in a plane substantially perpendicular to a line of sight of the shooting means, in one direction or another from a reference position corresponding to the reference view, to modify accordingly a region of interest of the image, displayed on the screen,

a rotation of the view of the scene at the exit of the shooting means, around an axis substantially perpendicular to the plane of the screen and / or a line of sight of the shooting means, in a direction or a another from a position of reference corresponding to the reference view, for controlling a rotation accordingly of the image displayed on the screen, and / or

an angular pivoting of the view of the scene at the exit of the shooting means, in one direction or another from a reference position corresponding to the reference view, about an axis included in the plane of the screen or perpendicular to the line of sight, to control a translation as a result of the image displayed on the screen;

- it is activated by an action of a user of the terminal;

the activation action of the user is an action on the screen of the terminal;

the activation action of the user is an action on a push button of the terminal;

- the scene is the environment in front of the screen;

- The environment scene in front of the screen integrates the head of a user of the terminal.

According to another aspect, the subject of the invention is also a system for controlling the display of at least one image on at least one screen of a terminal associated with means for shooting a scene, for the purpose of implementation of a method as described above, characterized in that it comprises means for establishing a reference display configuration in which the display of the image is associated with the view of the scene at the output of the shooting means and the means for detecting changes in the view of the scene at the exit of the shooting means, for controlling accordingly changes in the display of the image on the screen.

According to another aspect, the invention also relates to a user terminal, provided with a display control system as described above.

According to other characteristics of the terminal according to the invention taken alone or in combination:

it includes integrated shooting means;

- It comprises remote shooting means and connected thereto by connecting means;

the connecting means are chosen from the group comprising connecting means:

- wired,

- radio,

- infrared;

it is chosen from the group comprising: an information display monitor,

- a computer,

- a tablet,

- a connected watch,

- a smart phone

The invention will be better understood on reading the description which follows, given solely by way of example, and with reference to the appended drawings, in which:

FIG. 1 represents a block diagram illustrating an exemplary implementation of a method according to the invention;

FIG. 2 represents a flowchart illustrating various steps of such a method;

FIGS. 3, 4, 5 and 6 illustrate various display commands that can be implemented by means of such a method; and

- Figures 7 and 8 show alternative embodiments of a terminal implementing a control system according to the invention.

In these figures, and in particular in FIGS. 1 and 2, a method, a system and a user terminal implementing a display command according to the invention have in fact been illustrated in general.

In FIG. 1, a user terminal designated by the general reference 1, equipped with an information display screen designated by the general reference 2, is recognized.

This user terminal is for example made in the example described by a smartphone or tablet, comprising for example a touch screen or other.

It goes without saying of course that other terminals such as for example an information display monitor, a computer, a connected watch, etc. can be envisaged.

In general, such a terminal 1 equipped with its screen 2, is made available to a user such as a user 3 for displaying information on the screen, this information being for example constituted by at least one image.

Moreover, this terminal 1 is associated with means for shooting a scene, these shooting means being constituted for example by a camera or any other apparatus of this type, and being designated by the general reference 4 on this figure.

In the exemplary embodiment described in this FIG. 1, these recording means 4 are directly integrated in the terminal 1, for example on the same face thereof. than the screen and are therefore adapted to take a view of the scene formed by the environment in front of this screen 2.

Thus, in the example described, the environment scene in front of the screen integrates the head of the user of the terminal.

Indeed, this one looks at the screen.

In fact and in the method according to the invention, as described in FIG. 2, there is provided an activation / initialization step of the method by the user, designated by the general reference 5 in this FIG. establish a reference display configuration of the information on the screen.

In this reference display configuration, the display of the image is associated with the view of the scene at the exit of the shooting means.

This step of establishing the reference configuration is designated by the general reference 6 in this FIG.

Then, a step of detecting changes in the view of the scene at the output of the shooting means, at 7, is carried out by analyzing the output signals of these, so as to control changes in the picture accordingly. display the image on the screen.

This step of controlling the changes of the display of the image is designated by the general reference 8 in this FIG.

In fact and if we return to Figure 1, the method according to the invention can be activated by an action of a user of the terminal.

This action may for example be an action on an area, for example specific or not, of the screen of the terminal, as designated by the general reference 9 in this figure 1, if this terminal is for example a touch screen terminal.

The user can then activate the method according to the invention and in particular the first step of establishing the reference configuration, simply by pressing the touch screen.

Other ways of activating this method and the corresponding system can of course be envisaged.

Thus, the user can also press with a finger, for example on a push button of the terminal, this push button being designated by the general reference

10 in this figure 1.

It is then conceivable that, according to the exemplary embodiment which has just been described, during this first phase of operation of the method and the display control system according to the invention, the user of the terminal looks at the screen of this one and the Means of shooting take a view of the scene in front of this screen and in particular the head of the user.

When the user activates the method and the system according to the invention, by pressing the touch screen or the push button of the terminal, it then triggers the establishment by the system, a reference display configuration, in which the display of the image is associated with the view of the scene at the exit of the shooting means.

The system then monitors the view of the scene at the output of the shooting means, to detect changes in the view of this scene so as to control changes in the display of the image on the screen.

FIGS. 3, 4, 5 and 6 show such detections and modifications of the display of the image on the screen.

In these figures 3, 4, 5 and 6, the terminal 1, the user 3 and the screen 2 of the terminal 1 are recognized.

These different figures in fact illustrate the consequences, in terms of display of information on the screen, detections of changes in the scene view.

Thus, for example, in FIG. 3, the detection consists in detecting a change in the view of the scene at the output of the shooting means along an axis substantially perpendicular to the plane of the screen and / or along an axis of view. target of the shooting means, associated with a translation in one direction or another from the reference position corresponding to the reference view, to modify accordingly the enlargement / reduction factor of the image display on the screen.

Actually by pressing the activation button, the user of the terminal defines a reference position / distance for example of his head relative to the screen.

If the distance increases or decreases because the user decides to move towards or away from the screen, the system according to the invention will detect these changes and modify accordingly the enlargement / reduction factor of display the image on the screen.

Indeed, it can be considered that if the distance between the user's head and the screen is reduced, it is that the user wishes to observe a detail of the displayed image and that it is then appropriate to enlarge the displayed image.

On the contrary, when the distance between the user's head and the screen increases, it can be considered that the user wishes to reduce the displayed image in order to have an overall view thereof.

These are, of course, only examples of considerations.

Other changes can thus be analyzed, such as that illustrated in Figure 4. Indeed, it is possible for example to detect a rotation of the view of the scene at the output of the shooting means, around an axis substantially perpendicular to the plane of the screen and / or the axis of view of the means of view. shooting, in one direction or another from the reference position corresponding to the reference view, to control a rotation accordingly of the image displayed on the screen, as shown in this figure 4.

FIG. 5 illustrates the detection of an angular pivoting of the view of the scene at the exit of the shooting means in one direction or another around an axis included in the plane of the screen. from the reference position corresponding to the reference view, to control a translation as a result of the image displayed on the screen in the same way that the image returned by a mirror moves when a rotation is applied to that -this.

Finally, in FIG. 6, there is illustrated a change in the view of the scene at the exit of the shooting means by detecting a displacement in a plane substantially parallel to that of the screen and / or in a plane substantially perpendicular to the axis of view of the shooting means, in one direction or another from a reference position corresponding to the reference view, to modify accordingly a region of interest of the image, displayed on the screen.

In fact multiple detections of change, resulting in orders and corresponding display commands can thus be defined.

In a method and a system according to the invention, it is appropriate to define and activate the method, from a reference view as defined by the user, to then analyze changes in the view, and deduce therefrom control commands resulting in corresponding changes in the display of the image on the screen.

Of course other orders than those described can be envisaged.

In the example just described in particular in Figure 1, the shooting means are for example formed by a camera integrated in the terminal and placed for example on the face thereof comprising also the display screen.

Of course, other embodiments can be envisaged as illustrated in FIGS. 7 and 8.

In FIGS. 7 and 8, the shooting means may not be integrated in the terminal 1 and may be constituted for example by a separate camera and connected thereto, such as that designated by the general reference 4a in this FIG. .

These means of shooting can also consist of completely separate means and separated from the terminal, as illustrated in FIG. 8, where the shooting means designated by the general reference 4b, connected to the terminal, are recognized.

In this case the remote shooting means can be connected to this terminal by connecting means which can comprise conventionally, wired connection means, radio, or infrared, etc ..

Of course other embodiments can be envisaged.

It is then conceivable that such a method has a certain number of advantages over those implemented in the state of the art, insofar as they make it possible, from analysis of changes in views of a scene. , to deduce control commands from an image display on a screen.

In a similar manner to that described above, in the example described, the scene is a scene of the environment in front of the information display screen and which integrates for example a part such as the head of the user.

Of course, the means of shooting the environment may be arranged in another orientation to take for example views of the environment in front of the terminal or other.

Claims

1 .- Method for controlling the display of at least one image on at least one screen (2) of a terminal (1) associated with means (4; 4a; 4b) for shooting a scene , characterized in that it comprises a step (5, 6) for establishing a reference display configuration in which the display of the image is associated with the view of the scene at the output of the setting means and a step (7) for detecting changes in the scene view at the output of the shooting means, for controlling accordingly (8) changes in the display of the image on the screen.

2. A control method according to claim 1, characterized in that the detection step (7) consists in detecting in addition:

a rotation of the view of the scene at the exit of the shooting means, around an axis substantially perpendicular to the plane of the screen and / or a line of sight of the shooting means, in a direction or a another from a reference position corresponding to the reference view, to control a rotation as a result of the image displayed on the screen, and / or

an angular pivoting of the view of the scene at the exit of the shooting means, in one direction or another from a reference position corresponding to the reference view, about an axis included in the plane of the screen or perpendicular to the line of sight, to control a translation as a result of the image displayed on the screen.

3. A control method according to any one of the preceding claims, characterized in that it is activated by an action of a user (3) of the terminal (1).

4. - Control method according to claim 3, characterized in that the activation action of the user (3) is an action on the screen (2, 9) of the terminal (1).

5. - A control method according to claim 3, characterized in that the activation action of the user is an action on a push button (10) of the terminal.

6. A control method according to any one of the preceding claims, characterized in that the scene is the environment in front of the screen (2).

7. - control method according to claim 6, characterized in that the environment scene in front of the screen integrates the head of a user (3) of the terminal.

8. - Control system for displaying at least one image on at least one screen (2) of a terminal (1) associated with means (4; 4a; 4b) for shooting a scene , for the implementation of a method according to any one of the preceding claims, characterized in that it comprises means for establishing a reference display configuration in which the display of the image is associated with the view of the scene at the output of the shooting means and the means for detecting changes in the view of the scene at the output of the shooting means, for controlling accordingly changes in the display of the picture on the screen.

9. - User terminal, provided with a display control system according to claim 8.

10. - User terminal according to claim 9, characterized in that it comprises means (4) integrated shooting.

1 1. - User terminal according to claim 9, characterized in that it comprises means (4b) for shooting distant and connected thereto by connecting means.

12. - User terminal according to claim 1 1, characterized in that the connecting means are selected from the group comprising connecting means:

- wired,

- radio,

- infrared.

13. - User terminal according to any one of claims 9 to 12, characterized in that it is chosen from the group comprising:

an information display monitor,

- a computer,

- a tablet,

- a connected watch,

- a smart phone