FR3062732A1 - OPERATOR TERMINAL OF A MISSION CONTROL AND VISUALIZATION SYSTEM - Google Patents

Abstract

The invention relates to an operator terminal of a mission control and display system comprising a display screen and a man-machine interface for operator command input, a task comprising a time sequencing of a plurality of tasks, each task having an associated duration, said temporal sequencing being with or without temporal overlap between tasks. The terminal comprises a control and display multi-touch screen (12), comprising a rectangular display area (40) adapted to display a graphical component (50) for chronically displaying the tasks in the form of a ring portion, a cursor (52) indicating a reference time instant, interaction graphical elements (56A, 56E, 56G, 56) associated with each task and representative of the time duration of each task being arranged in said graphical component (50) chronological display of tasks.

Description

© Publication no .: 3,062,732 (to be used only for reproduction orders)

©) National registration number: 17 00109 ® FRENCH REPUBLIC

NATIONAL INSTITUTE OF INDUSTRIAL PROPERTY

COURBEVOIE © Int Cl ⁸ : G 06 F 3/0488 (2017.01), G 06 Q 10/10

A1 PATENT APPLICATION

Date of filing: 03.02.17. ©) Applicant (s): THALES Société anonyme - FR. © Priority : @ Date of availability of the request: 10.08.18 Bulletin 18/32. @ Inventor (s): LABORDE PIERRE and DURIEUX YVES. (56) List of documents cited in the preliminary search report: See the end of this brochure References to other related national documents: ©) Holder (s): THALES Société anonyme. o Extension request (s): ©) Agent (s): CABINET LAVOIX Simplified joint-stock company.

(04) OPERATOR TERMINAL OF A MISSION CONTROL AND DISPLAY SYSTEM.

FR 3 062 732 - A1 _ The invention relates to an operator terminal of a mission control and display system comprising a display screen and a man-machine interface allowing operator operator input, a mission comprising a temporal sequencing of a plurality of tasks, each task having an associated duration, said temporal sequencing being with or without temporal overlap between tasks. The terminal comprises a multi-touch touch screen (12) for control and display, comprising a rectangular display zone (40), suitable for displaying a graphic component (50) for chronological display of tasks in the form of a portion of a ring, a cursor (52) indicating a reference time instant, graphic interaction elements (56A, 56E, 56G, 56) associated with each of the tasks and representative of the time duration of each task being arranged in said graphic component (50) chronological display of tasks.

Operator terminal of a mission control and display system

The present invention relates to an operator terminal of a mission control and display system comprising a display screen and a man-machine interface for entering operator commands.

The invention is in the field of human-machine interfaces in the context of mission supervision and monitoring in a decision center, whether it is a civil or military mission.

In such a context, a mission comprises a temporal sequencing of a plurality of tasks, each task having an associated duration, the temporal sequencing being with or without temporal overlap between tasks.

Mission supervision has three main phases, a preparation phase, a phase of monitoring and ordering in real time, and an analysis phase after the actual progress of the mission. The later analysis phase is also called the restitution phase.

One of the problems to be solved is to provide the decision maker (s) and the team in charge of the preparation of the tools to prepare, monitor in real time, command / control and analyze a given mission. In particular, in the monitoring phase, a mission system must collect data from various sensors, relating to the progress of the mission, including temporal and geographic data, and provide a synthetic and understandable display of all the data collected.

Traditionally, the monitoring of the progress of a mission is carried out in a decision center, by several operators installed at various stations and receiving various collected data, each of the operators having the mission of synthesizing and presenting the results, for example on a viewing screen visible to all. The entire audience is made up of operators and decision-makers.

Similarly, the preparation phase is carried out from different operator stations and specialized.

Finally, the analysis phase is generally also carried out on dedicated stations, possibly different from the stations used for preparation and monitoring.

Thus, the tools are multiplied and in general, non-homogeneous. In addition, existing mission systems are somewhat complex and slow due to the collection of data on operator stations and their synthesis for display for decision-makers.

There is therefore a need to improve the consistency, readability and speed of data presentation, in the real-time mission monitoring phase, but also in the preparation and reporting phases.

To this end, the invention proposes, according to a first aspect, an operator terminal of a mission command and display system comprising a display screen and a man-machine interface allowing operator commands to be entered, a mission comprising a temporal sequencing of a plurality of tasks, each task having an associated duration, said temporal sequencing being with or without temporal overlap between tasks.

This operator terminal includes a multi-touch control and display touch screen, comprising a rectangular display area, suitable for displaying a graphical component for the chronological display of tasks in the form of a portion of a ring, a cursor indicating a time instant. reference, interactive graphical elements associated with each of the tasks and representative of the time duration of each task being arranged in said graphical component for chronological display of the tasks.

Advantageously, the graphic component of chronological display makes it possible to visualize the temporal sequencing of the tasks of the mission very quickly, and to select each of the tasks of the mission very easily.

The operator terminal according to the invention may also have one or more of the characteristics below, taken independently or in combination according to all technically acceptable combinations.

Each interaction graphic element associated with a task can be activated by the operator to control a detailed display of information relating to said selected task.

The graphical time display component has the shape of an elliptical or circular ring portion, and is placed near a first edge of the rectangular display area in a first display portion of area less than half of the surface of the display area.

The graphical time display component has a complete circular or elliptical ring shape, the ring being associated with a predetermined time duration.

Each task has an associated geographic location, and a map indicating a geographic location of each task is displayed in a second portion of the display area.

Each graphical element of interaction has a shape of a circular or elliptical ring portion, concentric with the graphic component for the chronological display of tasks, each portion having a first edge corresponding to an instant of start of associated task, and a second corresponding edge. at the end of an associated task.

Each graphical element of interaction includes a visual indication making it possible to distinguish whether the task end time is in the past relative to the reference time instant, if the task start time is in the future by relative to the reference time instant or if the reference time instant is between the task start instant and the task end instant.

The display in the display area is dynamically refreshed from information received from the mission system, and the graphical component of the task timeline is rotated in a predetermined direction based on a clock rate.

The cursor indicating a reference time instant remains at a predetermined position when the graphic component of the time display is rotated.

The graphic component for the chronological display of tasks can be activated in rotation by the operator, and in the mission preparation or restitution phase, the cursor indicating the reference time is repositionable by the operator.

A cursor indicating a time horizon at a predetermined time distance from the reference time instant is displayed.

Other characteristics and advantages of the invention will emerge from the description which is given below, for information and in no way limitative, with reference to the appended figures, among which:

- Figure 1 schematically illustrates an operator terminal in a context of use;

- Figure 2 is a representation in functional blocks of a programmable control device according to an embodiment of the invention;

- Figure 3 illustrates a first embodiment of a display area according to the invention;

- Figures 4 and 5 each illustrate a detail of a graphical display chronological component according to the invention;

- Figure 6 illustrates a second embodiment of a display area according to the invention.

The invention will be described below in its application in a mission system suitable for monitoring and supervising missions made up of tasks, each task having an associated duration and an associated geographical area. The tasks are to be performed according to a time sequence defined in the preparation phase.

The invention applies more generally to mission supervision and monitoring, in any civil or military context in which several people are called upon to intervene for the preparation, monitoring and decisions to be taken in real time and for analysis. post-operational.

By mission is meant a set of tasks to be performed, which can have interactions in real time, each task having an associated duration, several tasks being able to take place at the same time.

FIG. 1 schematically illustrates an application context of an operator terminal according to the invention. It is an operational decision center, for example a room 1 in which several people 2, who are operators and / or decision-makers, are present, around an operator terminal 10 of the mission system.

To make it easier to understand, the operator making orders is not shown in the place provided.

The operator terminal 10 includes a man-machine interface 12, which is a multi-touch control and display touch screen.

In addition to this control and display screen 12, a second screen 14 intended for display is present in the room.

The screens 12, 14 are each connected to a programmable control device 16.

Preferably, the control and display screen 12 is integrated into a table 18 disposed substantially horizontally or at a small angle of inclination relative to the horizontal, at a chosen height, and preferably adjustable, to allow manipulation of easy operation by an operator standing next to the table.

In an alternative embodiment, the programmable control device 16 is integrated into the table 18.

Preferably, the control and display screen 12 is of rectangular shape with a diagonal greater than or equal to 40 inches, in order to allow viewing and interaction comfort for several people around the table.

The control and display screen 12 is adapted to display a graphic component 20 for the chronological display of the tasks 22a to 22n of the mission. The graphic component 20 is also an interaction component, allowing an operator to select one or more tasks and to order the detailed display thereof on the control and display screen 12 and / or on the second screen 14 intended to visualization.

The graphic component 20 corresponds to a predetermined total time duration, for example a number of hours.

Advantageously, the position of the control and display screen, and the position of the graphic component 20 on this screen allow a main operator to carry out commands in a comfortable position, without muscle fatigue.

To facilitate understanding, the main operator carrying out commands has not been shown in FIG. 1 at the intended location which is next to the edge 19 of the table 18, near which is displayed the graphic display component 20 chronological of the tasks.

Preferably, a georeferenced view 24 of the mission is displayed on the control and display screen 12 and / or on the screen 14.

Advantageously, all the people located around the screen 12 can benefit from both a georeferenced spatial view and a chronological view of all the tasks of the mission.

Therefore, a synthetic and comprehensible overview is provided, while allowing to select and display detailed information relating to one or more past, running or future tasks, as described in more detail below. after.

In the real-time mission monitoring phase or in the analysis phase, also called the mission restitution phase, the display is refreshed in real time, according to the passage of time and according to data from sensors and retrieved by the operator terminal via suitable communication modules, for example radio communication transmitters / receivers.

FIG. 2 schematically illustrates the functional blocks of a control device forming part of the operator terminal according to one embodiment.

The control device 16 comprises an input / output module 26 connected to the multi-touch control and display touch screen 12, making it possible to receive commands and to modify the display.

The device 16 also includes a central processing unit 28, or CPU, capable of executing computer program instructions when the device 16 is powered up.

The central processing unit 28 is in communication with one or more information storage modules 30, for example registers, capable of storing executable code instructions and parameter values for the implementation of programs comprising instructions of code adapted to implement the method of the invention.

A communication module 32 makes it possible to receive data collected by various sensors connected to the mission system (not shown), for example cameras, radars.

The various modules of the control device 16 described above are connected via a communication bus.

The central processing unit 28 implements a module 34 for generating and displaying a graphical component for chronological display of tasks, the graphical display component comprising graphical elements of interaction associated with the tasks, and a module 36 for receiving commands linked to graphic elements for interaction and display modification as a function of the commands received.

FIG. 3 schematically illustrates a rectangular display area 40 of a multi-touch control and display touch screen 12 according to a first embodiment of the invention.

In this embodiment, the display area 40 comprises a first display portion 42 and a second display portion 44. The first display portion is dedicated to the chronological display of the tasks and to the control buttons and the second display portion 44 for displaying a georeferenced global view, optionally with detailed display relating to one or more tasks.

In one embodiment, the first display portion has an area less than half the area of the display area.

A control bar 46 is displayed in the first display portion 42, glued to an edge 47 of this first display portion. The edge 47 of the first display portion is the edge closest to the main operator.

A graphical component 50 for chronological display of the tasks, in the form of an elliptical ring portion, is displayed, glued to the control bar 46, delimited by an internal contour 50a, and an external contour 50b, the contours 50a and 50b corresponding to concentric ellipses, the center not being shown in the figure.

As a variant, the graphic display component has a shape of a circular ring portion, and the contours 50a and 50b belong in this case to concentric circles.

Preferably, the graphic component 50 is centered relative to the edge 47 of the first display portion.

The graphic display component preferably has a predetermined size, not proportional to the size of the display screen 12, and chosen according to the average morphology of an operator.

According to one embodiment, the predetermined size of the graphic display component is defined by the diameter corresponding to the external contour 50b and is given in centimeters. Preferably, the size can be resized on operator command, to better adapt to a given operator.

The command bar displays various command buttons 46 _a to 46 _k . For example, each control button has a shape associated with its function, and / or when a control button is pointed or touched by an input means, a text menu with explanations relating to the control button is displayed on the screen. 'screen.

According to one embodiment, the appearance of the control bar 46 is modified according to the mission phase: preparation, monitoring or restitution.

For example, in the restitution phase, a control button 46 can be actuated to play or stop the restitution of the progress of the mission from the data recorded in the memory 30 of the control device 16. Preferably, various options are selectable by the operator, for example a speed of restitution which is defined by a multiplicative factor compared to the real time speed of the mission.

In the embodiment illustrated in FIG. 3, a cursor 52 indicating the reference time instant T _ref is displayed superimposed on the graphic component 50, as well as a cursor 54 indicating a time horizon T _f relative to the reference instant, where T _f = T _ref + A, with Δ for example equal to 60 minutes.

The reference time instant T _ref represents "the present instant" displayed on the screen 12.

The cursor 54 is optional, its display being able to be suppressed by an action of the operator.

The graphic component 50 displays interaction elements 56A to 56G associated with the tasks A to G of the mission.

Each interaction element 56 is represented in the form of a ring portion, formed by concentric arcs lower 57a and upper 57b, also concentric with the contours 50a, 50b of the graphic component 50, and radial end edges 58, 59.

In a first embodiment, the angle defining a radial (52, 54, 58, 59) relative to a reference line passing through the center of rotation of the graphic component 50 is linearly related to time.

In this first mode and in the case of portions of circular rings, tasks of the same duration on the same circular ring will have identical lower arc lengths 57a and identical upper arc lengths 57b.

In this first mode and in the case of portions of elliptical rings, tasks of the same duration on the same elliptical ring will not necessarily have identical lower arc lengths 57a and identical upper arc lengths 57b. The arc lengths will change according to their angular position on their ellipse. The lengths increase while going towards the major axis of the ellipse and decrease while going towards the minor axis of the ellipse.

In a second embodiment, when the graphic component 50 is elliptical, so as to obtain identical lower arc lengths 57a and identical upper arc lengths 57b for tasks of the same duration and located on the same elliptical ring, the time is distributed linearly over the ellipses used, a time cursor 52, 54, always marking the same time well over all of the intercepted ellipses.

The position of the interaction element 56 in the graphic component is determined as a function of the task start time instant and the task end time instant relative to the reference time instant. The first edge 58 of an interaction element 56 is representative of the task start time instant and the second edge 59 is representative of the task end time instant.

Thus, when the time instant at the end of the task 59 is located before the reference time instant T _ref , the progress of the task is situated in the past with respect to the reference time instant.

When the task start time instant 58 is after the reference time T _ref , the progress of the task is in the future with respect to the reference time instant.

When the reference time instant T _ref is between the time instant of start of task 58 and the time instant of end of task 59, the task takes place in the present.

Preferably, a differentiated visual display is applied according to the temporal position of the task with respect to the reference temporal instant, so as to allow the main operator and all the people to quickly grasp this information.

For example, depending on the time position relative to the reference time, the display color of the corresponding interaction element is different.

Optionally, as illustrated in FIG. 3, the display also makes it possible to distinguish a task which will be active at the time instant T _f defined by the operator. In the example of FIG. 3, the corresponding interaction element 56 is in white.

Each interaction element 56 corresponding to a given task is preferably displayed entirely, without overlapping with another interaction element. If several tasks are planned in parallel, for example tasks A and E associated with the interaction elements 56A and 56E of FIG. 3, these interaction elements 56A and 56E are represented in spatial offset on rings of different radii, so as to be visible without overlapping.

The width of each portion of ring 56 is chosen, firstly as a function of the size of the graphic component 50 and of the number of tasks having a temporal overlap.

In the case where the tasks are linked chronologically without temporal superposition, all the portions of ring constituting interaction elements associated with the tasks can be represented centered on the same elliptical or circular arc.

In the preferred embodiment, the graphic component 50 rotates, as time goes by, in the direction of the arrow 60, the cursor 52 indicating the reference time instant being fixed.

The flow of time is either defined by a clock rate, which is either a clock rate internal to the control device during a mission monitoring phase in real time, or a rate defined by the speed of restitution defined by the operator.

In the real-time monitoring phase and in the restitution phase, on the second display portion 44 are displayed in a global map, geographic areas associated with the respective tasks.

For the tasks in progress, additional information, for example the movement of vehicles associated with a task in the example of FIG. 3, is also displayed, allowing monitoring of the progress of the task.

The invention is compatible with the introduction of various means for real-time control of the tasks in progress.

If necessary, the second display portion 44 is subdivided in order to be able to keep a view of the global mapping and detailed information relating to a task in progress or to a task selected by the operator, according to information received from various sensors.

Preferably, visual indicators, for example display in gray or in a given color, make it possible to distinguish very quickly between past, current and future tasks on the global mapping.

In the mission preparation phase, the main operator has the possibility of rotating the graphic component 50 and of moving the interaction elements relating to the tasks, so as to modify their chronological order or to modify their size to modify the duration of associated tasks. When the graphic component is rotated by operator action, the cursor 52 indicating the reference time instant is also moved.

FIG. 4 shows a detail of the graphic component 50 of chronological display of the tasks, and the action of controlling the rotation of this graphic component by a touch and movement action performed by a finger of the main operator.

By a different tactile command, for example by pressing on a given interaction element 56, a detailed display relating to the task associated with interaction element 56 is controlled.

FIG. 5 illustrates the possibility offered to the operator of moving the cursor 52 indicating the reference time instant, in the preparation or restitution phase, in order to allow a display of the planned or memorized sequence using as reference time instant a later instant indicated by cursor 52 '. The detail display 64 is updated according to the reference time instant selected by the operator.

FIG. 6 schematically illustrates a rectangular display area of a multi-touch control and display touch screen 12 according to a second embodiment of the invention.

It should be noted that this second embodiment is compatible with the first, an operator being able for example to control a switching between the first display mode and the second display mode, according to his needs, for example by pressing a button. control bar 46.

In the embodiment of FIG. 6, a graphic component 70 for the chronological display of the tasks in the form of a complete circular ring displayed in the center of the display area 72.

This display makes it possible to have a complete chronological view over a given duration which is the total duration associated with the graphic component 70, which can be configured by the operator, for example 12 hours or 24 hours.

For example, if the complete circle 70 represents 24 hours, a task of duration equal to 1 hour intercepts an angle of 15 °.

A control bar 46, similar to that shown in FIG. 3, is displayed, glued to an edge of the display area 72.

For example, the switching between the display mode of FIG. 3 and the display mode of FIG. 6 is selected by the operator by pressing a button 73 on the command bar 46.

A cartography 74 representative of the georeferenced positions of the task flow zones is displayed on a portion of the display zone, in the background of the display of the graphical component 70 of the chronological task display.

In one embodiment, detailed information 75 relating either to a task G being executed in the tracking or restitution mode, or to a task selected by the operator, is displayed in the center of the display area 72, in a circular zone delimited by the inner edge 70a of the circular ring forming the graphic component 70.

In the example of FIG. 6, information relating to task G, associated with the interaction element 76G, is displayed in the center of the display area 72.

Analogously to what has been described with reference to FIG. 3, the graphic component 70 displays interaction elements 76 associated with the mission tasks, each interaction element being a portion of a circular ring, the elements d the interaction being formed by concentric arcs with circular contours 70a, 70b of the graphic component 70.

Each ring portion is defined by its edges 78, 79, the first edge 78 corresponding to a task start instant and the second edge 79 corresponding to a task end instant.

A cursor 80 indicating the reference time instant T _ref is displayed superimposed on the graphic component 70.

In the embodiment in which a second screen 14 dedicated to the display is available, a complete map is displayed on the screen 14, while the graphic component 70 occupies the control and display screen 12.

This display mode is particularly useful when the mission includes many tasks spanning a long period of time.

Claims (11)

1, -Operator terminal of a mission control and display system comprising a display screen and a man-machine interface allowing operator commands to be entered, a mission comprising a temporal sequencing of a plurality of tasks, each task having an associated duration, said temporal sequencing being with or without temporal overlap between tasks, characterized in that it comprises: - a multi-touch control and display touch screen (12), comprising a rectangular display area (40, 72), adapted to display a graphic component (20, 50, 70) of chronological display of the tasks in the form of a portion ring, a cursor (52, 80) indicating a reference time instant, graphical elements of interaction (22a-22n, 56, 56A-56G, 76) associated with each of the tasks and representative of the time duration of each task being arranged in said graphical component (20, 50, 70) of chronological display of the tasks. 2, - operator terminal according to claim 1, wherein each graphical element of interaction (22a-22n, 56, 56A-56G, 76) associated with a task is operable by the operator to control a detailed display of information relating to said selected task. 3, - operator terminal according to one of the preceding claims, in which the graphic component (20, 50) of chronological display has the shape of a portion of elliptical or circular ring, and is placed near a first edge (47) of the rectangular display area in a first display portion (42) with an area less than half the area of the rectangular display area. 4, - operator terminal according to one of claims 1 or 2, wherein the graphic component (70) of chronological display has the shape of a complete circular or elliptical ring, the ring being associated with a predetermined time duration . 5, - Operator terminal according to one of claims 3 or 4, in which each task has an associated geographic location, and in which a map indicating a geographic location of each task is displayed in a second portion (44) of the display area. 6, - Operator terminal according to one of the preceding claims, in which each graphical interaction element (56, 76) has the shape of a circular or elliptical ring portion, concentric with the graphical component for the chronological display of tasks. , each ring portion having a first edge (58, 78) corresponding to an associated task start instant, and a second edge (59, 79) corresponding to an associated task end instant. 7, - operator terminal according to claim 6, wherein each graphical element of interaction (56, 76) includes a visual indication making it possible to distinguish if the task end time is in the past relative to the reference time point, if the task start time is in the future relative to the reference time point or if the reference time point is between the task start point and the point of time end of task. 8, - operator terminal according to one of the preceding claims, in which the display in the display area is dynamically refreshed from information received from the mission system, and the graphic component (20, 50, 70 ) chronological display of tasks is rotated in a predetermined direction according to a clock rate. 9, - operator terminal according to claim 8, wherein the cursor (52, 80) indicating a reference time instant remains at a predetermined position when the graphic component of the chronological display is rotated. 10, - Operator terminal according to one of claims 1 to 8, in which the graphical component for chronological display of the tasks can be actuated in rotation by the operator, and in the mission preparation or restitution phase, the cursor indication of the reference time instant is repositionable by the operator. 11, - Operator terminal according to one of claims 1 to 10, in which a cursor (54) indicating a time horizon at a predetermined time distance from the reference time instant is displayed.