GB2530764A - Simulation system user interface - Google Patents

Simulation system user interface Download PDF

Info

Publication number
GB2530764A
GB2530764A GB1417329.8A GB201417329A GB2530764A GB 2530764 A GB2530764 A GB 2530764A GB 201417329 A GB201417329 A GB 201417329A GB 2530764 A GB2530764 A GB 2530764A
Authority
GB
United Kingdom
Prior art keywords
simulation
entity
entities
simulated
user interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1417329.8A
Other versions
GB201417329D0 (en
Inventor
Martin Alan Jones
Andrew George Nott
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BAE Systems PLC
Original Assignee
BAE Systems PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BAE Systems PLC filed Critical BAE Systems PLC
Priority to GB1417329.8A priority Critical patent/GB2530764A/en
Publication of GB201417329D0 publication Critical patent/GB201417329D0/en
Priority to US15/515,192 priority patent/US20170221382A1/en
Priority to PCT/GB2015/052791 priority patent/WO2016051143A1/en
Priority to EP15781982.2A priority patent/EP3201898A1/en
Priority to AU2015326570A priority patent/AU2015326570A1/en
Publication of GB2530764A publication Critical patent/GB2530764A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/24Use of tools
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/003Simulators for teaching or training purposes for military purposes and tactics
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • G09B9/16Ambient or aircraft conditions simulated or indicated by instrument or alarm
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • G09B9/02Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/08Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
    • G09B9/22Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer including aircraft sound simulation

Abstract

Distributed Interactive Simulation (DIS) is a data communication standard published by the Simulation Interoperability Standards Organisation (SISO) relating to the interconnection of simulators (e.g. pilot/flight simulators and mission/airspace controller simulations). It includes audio/voice communication capabilities. The invention focuses on providing a simulated radio for voice communications in the simulations. In particular it proposes a touchscreen interface with icon based controls for setting frequencies (Fig. 5), channels (Fig. 4), volume levels/balance (Fig. 6) and activating push to talk (PTT) functionality. Simulation of vehicles other than aircraft is envisaged in the application, as well as communication protocols other than DIS. The simulated radio may include functionality absent from that which is being simulated.

Description

SIMULATION SYSTEM USER INTERFACE
FIELD OF THE INVENTION
The present invention relates to a user interface for use with transferring S audio/voice communications data between different simulators in a simulation exercise, for example in a distributed simulation exercise.
BACKGROUND
A known standard for transferring data between distributed sites and simulators for combat aircraft and other military assets is the Distributed Interactive Simulation (DIS) standard. DIS was originally published in 1995 by Simulation Interoperability Standards Organization (SISO) and subsequently up-issued in 1998 and 2012. In simple terms, one characteristic of DIS is that it defines the way in which three classes of data are transferred between simulators.
The three classes are as follows.
i) Entity State -The identity, position and velocity of vehicles, weapons, people, and so on. This is often referred to as "Ground Truth" since this information can always be precisely known to the simulations / exercise controllers / test directors. This may be contrasted with "perception I perceived data" where the location of vehicles sensed via some sensor (real or simulated) will be subject to measurement errors, transmission delays, line of sight issues, and so on.
ii) Audio / Voice Communications. This refers to the simulation of voice communications, which re typically via VHF radio in the real world systems being simulated. The DIS standard specifies that simulation data must transport recorded voice together with meta-data identifying frequency of broadcast and transmitter identity / location I transmission status to all radio software users.
iii) Tactical Data Link (TDL): This represents simulation of the messaging service of real world military aircraft via real standards such as Link 16. These messages convey, for example, tactical information such as threat and target locations and orders, mission data, status reports, and so on.
SUMMARY OF THE INVENTION
S The present inventors have realised that it would be desirable to provide enhanced ways in which the audio/voice communications data may be transferred between different simulators in a distributed simulation exercise.
The present inventors have further realised it would be desirable if any one or more of the following considerations could also be included: i) if the enhancement could be provided in a manner compliant with the existing requirements of DIS; ii) if the enhancement could be provided in a manner that allowed it to be implemented simultaneously in different examples and types of simulators, preferably including different simulators where some or all were developed by different companies to represent dissimilar real world entities/ platforms/vehicles for different uses; iii) if the enhancement could be provided in a manner that allows some or all of the operators taking part in the simulation exercise (and technical support people) to communicate using familiar techniques such as push-to-talk (PIT), and/or frequency selection from among the many simulated frequencies required for a complex simulated battle space and the supporting technical channels required to support and co-ordinate the simulated mission; iv) if the enhancement could be provided in a manner that enables it to be implemented with a wide variety of underlying software such as different computer operating systems (i.e. is "portable"); v) if the enhancement could be provided in a manner that provided flexibility in areas such as configurable radio setups, many channels, interoperability, and so on; vi) if the enhancement could provide additional features and functionality that are attractive in simulations (for examples features that are beneficial in a training or practice environment) but that are not desired or preferred in the real world implementation of the activity being simulated.
The present inventors have further realised it would be desirable if a graphical user interface (GUI) and/or the audio input (or inputs) and/or the audio output (or outputs) could be provided in a manner that gives increased usability to pilots and other operators including more realistic feel of use.
In a first aspect, the invention provides a user interface for a simulated wireless arrangement, wherein the simulated wireless arrangement is for communicating audio content in a distributed simulation process, wherein the distributed simulation process is a flight operation and control exercise performed by a plurality of simulation entities (8, 10) each representing a real-world entity, at least some of the real-world entities being from one or more of the following group of entity types: i) vehicles, ii) mission controllers, iii) airspace controllers; the user interface comprising: audio input and output means (24, 260) arranged for a human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to input and receive output of speech during the distributed simulation process; and simulated wireless control input means (62, 90, 110), for use by the human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to control the simulated wireless arrangement; the simulated wireless control input means comprising screen icons (64, 68, 70 72, 74, 76) adapted for the human operator to press, the icons (64, 68, 70 72, 74, 76) allowing control input related to one or more of the following group of functionalities of the simulated wireless arrangement: i) push-to-talk; ii) selection between a plurality of simulated wireless channels; iii) selection of respective simulated frequencies for the plurality of simulated wireless channels.
The user interface may be defined as a further simulation entity forming a further one of the plurality simulation entities defined for the distributed simulation process, arranged for the human operator to thereby control at least two of the simulation entities, one being the user interface and the other being an associated one of the plurality of simulation entities (8) that simulates a real-world entity from the following group of entity types: i) vehicles, ii) mission controllers, iH) airspace controller.
The user interface may comprise further icons (116, 118, 126, 128) allowing volume control input related to one or more of the following group of volume control functionalities of the simulated wireless arrangement: i) volume level control, ii) volume balance between left and right ear control, iii) feedbacklsidetone level control.
The user interface may comprise further icons allowing text communication input.
The user interface may be arranged to allow a larger selection of input control possibilities compared to what is available in the real-world entity that the simulation entity (8) is simulating in the distributed simulation process.
The simulation entity (8) may be simulating an aircraft, and the human operator is performing simulated piloting of the aircraft.
The distributed simulation process may be performed according to a Distributed Interactive Simulation, DIS, as issued by the Simulation Interoperability Standards Organization, SISO.
In a further aspect, the invention provides a method for a simulated wireless arrangement, wherein the simulated wireless arrangement is for communicating audio content in a distributed simulation process, wherein the distributed simulation process is a flight operation and control exercise performed by a plurality of simulation entities (8, 10) each representing a real-world entity, at least some of the real-world entities being from one or more of the following group of entity types: i) vehicles, ii) mission controllers, iii) airspace controllers; the method comprising employing a user interface to implement: during the distributed simulation process, inputting and receiving output of speech via audio input and output means (24, 260) arranged for a human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to provide the speech for input and receive the audio output; and simulated wireless control input means (62, 90, 110), for use by the human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to control the simulated wireless arrangement; the simulated wireless control input means comprising screen icons (64, 68, 70 72, 74, 76) adapted for the human operator to press, the icons (64, 68, 70 72, 74, 76) allowing control input related to one or more of the following group of functionalities of the simulated wireless arrangement: i) push-to-talk; ii) selection between a plurality of simulated wireless channels; iii) selection of respective simulated frequencies for the plurality of simulated wireless channels.
The user interface may be defined as a further simulation entity forming a further one of the plurality simulation entities defined for the distributed simulation process, arranged for the human operator to thereby control at least two of the simulation entities, one being the user interface and the other being an associated one of the plurality of simulation entities (8) that simulates a real-world entity from the following group of entity types: i) vehicles, ii) mission controllers, iii) airspace controller.
The user interface may comprise further icons (116, 118, 126, 128) allowing volume control input related to one or more of the following group of volume control functionalities of the simulated wireless arrangement: i) volume level control, ii) volume balance between left and right ear control, iii) feedback/sidetone level control.
The user interface may comprise further icons allowing text communication input.
The method may comprise the human operator being provided with a larger selection of input control possibilities compared to what is available in the real-world entity that the simulation entity (8) is simulating in the distributed simulation process.
The simulation entity (8) may be simulating an aircraft, and the human operator is performing simulated piloting of the aircraft.
In a further aspect, the invention provides a program or plurality of programs arranged such that when executed by a computer system or one or more processors it/they cause the computer system or the one or more processors to operate in accordance with the method of any of the above aspects.
In a further aspect, the invention provides a machine readable storage medium storing a program or at least one of the plurality of programs according to the aspects of the preceding paragraph.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is a schematic block diagram representation of a simulation network; Figure 2 is a schematic illustration (not to scale) showing certain elements of each of a plurality of primary entities that are shown in Figure 1; Figure 3 is a schematic functional representation of one example of a primary entity where each block corresponds to a respective different function and where each block accordingly represents a respective functional module of the primary entity, and where each block may also be considered as representing a corresponding step or sub-process of a simulation process implemented by the primary entity; Figure 4 is a schematic illustration (not to scale) of a screen that displays various icons including a plurality of channel icons; Figure 5 is a schematic illustration (not to scale) of a frequency screen of a channel; and Figure 6 is a schematic illustration (not to scale) of a volume screen 110 of the channel whose frequency screen is shown in Figure 5.
DETAILED DESCRIPTION
Figure 1 is a schematic block diagram representation of a first embodiment of a simulation network 1. The simulation network 1 comprises a plurality of simulation entities (hereinafter referred to as entities). Each of the entities is, in this embodiment, located at one of three locations, namely a first location 2, a second location 4, or a third location 6.
In this embodiment the entities will be referred to, for convenience, as either a primary entity 8 or a secondary entity 10. In this embodiment the entities are located as follows: three primary entities 8 and two secondary entities 10 are coupled to each other and are located at the first location 2; one primary entity 8 and one secondary entity 10 are coupled to each other and located at the second location 4; and one primary entity 8 and one secondary entity 10 are coupled to each other and located at the third location 6.
In this embodiment, the three primary entities 8 at the first location 2 are simulation entities that each simulate a respective manned combat aircraft. In a simulation exercise, each of these aircraft simulation entities will be operated by a respective pilot undergoing training/practice. One of the secondary entities 10 at the first location 2 is a controller entity that will be operated by a training controller. The other of the secondary entities 10 at the first location 2 is a technical support entity that will be operated by a technical support person.
In this embodiment, at the second location 4, the primary entity 8 is a simulation entity that simulates a real-world Airborne Command & Control entity (such as, for example, the console of a Fighter Controller) and that will be operated by a person familiar with the required operation of the real-world Airborne Command & Control entity that is being simulated in the simulation exercise. The secondary entity 10 at the second location 4 is a technical support entity that will be operated by a technical support person.
In this embodiment, at the third location 6, the primary entity 8 is a simulation entity that simulates a real-world maritime or other type of airspace control system, for example: that of the Type 45 Destroyer, an Air Defence Destroyer. This primary entity 8 will be operated by a person familiar with the required operation of the corresponding real-world entity that is being simulated in the simulation exercise. The secondary entity 10 at the third location 6 is a technical support entity that will be operated by a technical support person.
In this embodiment the three locations 2, 4, 6 are located in three different pads of the same country, for example approximately 100-200 miles from each other. However, this need not be the case, for example in other embodiments they may be closer or further apart, and may be in different countries.
Network links 12 are provided between the different locations 2, 4, 6. The network links 12 may be provided by any suitable means, and the choice may be related to the protocols being employed in the simulation. In this embodiment the network links 12 are secure Internet Protocol (IP) connections using dedicated connections over the Internet.
Figure 2 is a schematic illustration (not to scale) showing certain elements of each primary entity 8 (and the same elements may be comprised by each of the secondary entities 10).
In this embodiment the primary entity 8 is implemented as a personal computer, comprising the following elements coupled to each other in conventional fashion: a processor 14 (or plural processors); a memory 16 (or plural memories); a graphical user interface (GUI) 18, comprising one or more user input means, for example keyboard/keyboards, touch screen/touch screens, joystick, foot control bar/control bars, and so on, the GUI 18 further comprising one or more user output means, for example one or more displays (which may be in the form of the previously mentioned possibility of touch screen/touch screens), haptic outputs, and so on; a data input port 20 (or other data input means or plural data input ports/means); a data output port 22 (or other data output means or plural data output ports/means); an audio input 24 (for example an inbuilt microphone and associated electronics, or electronics for coupling to a microphone or microphones) (or plural audio inputs); and an audio output 26 (for example an inbuilt speaker and associated electronics, or electronics for coupling to a speaker or a headphone set) (or plural audio outputs). It is noted that the audio input (or inputs) 24 and audio output (or outputs) 26 may be considered as being part of the GUI 18, however for ease of reference they are described here as being separate items to the GUI.
In this embodiment, a variety of simulation functions are provided by the operation of the above described elements of one or more of the primary entities 8 (and optionally one or more of the secondary entities 10). Figure 3 is a schematic functional representation of one example of such a primary entity 8 where each block corresponds to a respective different function and where each block accordingly represents a respective functional module of the primary entity 8, and where each block may also be considered as representing a corresponding step or sub-process of a simulation process implemented by the primary entity 8.
In this embodiment the functional modules comprise the following: a multi-screen module 32; a channel module 34; a volume module 36; a PTT-activate module 38; a chat module 40, a configuration module 42; a fade module 44; and a cut-out module 44. However, in other embodiments, any one or more of the above mentioned modules may be omitted, and/or one or more further different modules may be included.
In this embodiment, a multiscreen GUI is provided by operation of the multi-screen module 32. In this embodiment, three views are provided as shown respectively in Figures 4, 5 and 6. It will be understood that the three screens may be displayed on separate areas of a common display device, or may be displayed on respective display devices. Another possibility is at different times only one or two (in any combination) may be displayed but not the remainder one(s). In this embodiment the screens are each implemented on touchscreens, and thereby at least some of the displayed icons are also input buttons. Another possibility is that only some of the displayed icons are also input buttons.
Figure 4 is a schematic illustration (not to scale) of a first screen 62. A plurality of simulated radio channels (hereafter referred to as channels) is provided by operation of the channel module 34. The first screen 62 displays a plurality of channel icons 64 (each also serving as an input button), each channel icon 64 displaying an allocated name of a respective one of the channels and its selected (simulated) frequency value. The naming of the channels and the selection of the selected frequencies are implemented by the channel module 34. In this embodiment, when a user presses a channel icon 64 the display displays a second screen 90, which may conveniently be termed a frequency screen 90, which will be described later below with reference to Figure 5.
The first screen 62 further displays a plurality of volume level icons 66 (each also serving as an input button). Each volume level icon 66 is associated with a respective channel and hence also with a respective channel icon 64.
Each volume level icon 66 displays a volume level indication for its respective channel, and also an indication of which of at which of user's left and/or right audio outputs (e.g. left and/or right earpiece of a set of headphones) the indicated volume level is being provided. In this embodiment, when a user presses a volume level icon 66 the display displays a third screen 110, which may conveniently be termed a volume screen 110, which will be described later below with reference to Figure 6.
The first screen 62 further displays a plurality of volume screen select icons 68 (each also serving as an input button). Each volume screen select icon 68 is associated with a respective channel and hence also with a respective channel icon 64. In this embodiment, when a user presses a volume screen select icon 68 the display displays the volume screen 110, which will be described later below with reference to Figure 5. That is, in this embodiment, a user may press either the volume level icon 66 or the volume screen select icon 68 to go to the volume screen 110.
The first screen 62 further displays a plurality of mute icons 70 (each also serving as an input button). Each mute icon 70 is associated with a respective channel and hence also with a respective channel icon 64. In this embodiment, when a channel is not muted, the mute icon 70 displays that a change to mute can be made and if a user presses the mute icon 70 the sound is muted on the associated channel; and vice-versa when a channel is already muted, the mute icon 70 displays that a change to unmuted can be made and if a user presses the mute icon 70 the sound is unmuted, i.e. restored to the level prior to muting, on the associated channel. In this embodiment, mute inhibits transmission automatically, as does reducing the volume past a low threshold. However, this needs not be the case in other embodiments.
The first screen 62 further displays a plurality of transmitting icons 72 and a plurality of receiving icons 74. Each transmitting icon 72 is associated with a respective receiving icon 74, and each associated pair of transmitting icon 72 and receiving icon 74 is associated with a respective channel and hence also with a respective channel icon 64. In this embodiment, when a channel is transmitting this is indicated by the transmitting icon 72 being in an indication state (e.g. highlighted or flashing), and when a channel is receiving this is indicated by the receiving icon 74 being in an indication state (e.g. highlighted or flashing). In this embodiment, the software can be configured to inhibit transmission on a channel while there is incoming audio being received on that channel in order to provide an approximation of real radio operation. This need not be the case in other embodiments.
The first screen 62 further displays a plurality of PTT icons 76 (each also serving as an input button). Each PTT icon 76 is associated with a respective channel and hence also with a respective channel icon 64. In this embodiment, a user presses the PU icon 76 to provide for a voice input capability. In this embodiment, the primary mode comprises clicking and holding down (e.g. retaining pressure on a touch screen, or holding down a mouse button) the PTT icon 76 while talking and only releasing the PTT icon 76 after the user finishes talking, as in conventional real-world push-to-talk radios.
When the voice input capability is activated, this is indicated by the PU icon 76 being in an indication state. In this embodiment, the PTT icon 76 is highlighted in a first colour, (for example red) when PTT is active. When PIT is not active, the previously used PTI is highlighted in a second different colour (for example purple) until either the same PIT icon 76 is clicked again, or a different PTT icon 76 is clicked. In other embodiments other indications may be employed. For example the previously used PTT may not be highlighted, and/or other indications such as flashing or other types of highlighting may be used instead.
In this embodiment the following optional, secondary, mode of operation is employed; however this need not be the case for other embodiments. This mode may be termed, for convenience, an "open microphone" arrangement. In addition to the primary mode of operation, a pre-determined keyboard combination may be pressed in order to change the state of the channel module 34 which is presently in use. In this secondary mode of operation, a single short press of the determined combination will toggle the transmitting state of the active channel module 34, and the active PTT icon 76. This mode may be termed "open microphone" because, contrary to the primary mode of operation, the key combination need not be held down for the duration of the period where the user is speaking. It must, however, be pressed again to terminate transmission. In this embodiment there is no mouse or touch screen based equivalent to this mode of operation, and the use of the keyboard combination to alter the state of the FIT icon 76 overrides any mouse or other input on the PTT icon 76. This need not be the case in other embodiments.
The PTT functions, including those indicated by the GUI aspects described in this paragraph and the preceding paragraph, are implemented by the PTT-activate module 38.
As mentioned earlier above, when a user presses the channel name icon 64 of the first screen 62, the frequency screen 90 is displayed. More particularly, a frequency screen 90 corresponding to the particular channel whose channel name icon 64 was pressed is displayed. By way of example, Figure 5 is a schematic illustration (not to scale) of the frequency screen 90 of the channel whose name is "GOLD3". Any appropriate GUI layout may be employed to allow a new frequency value to input for the respective channel. In this embodiment the touchscreen displays a numeric keyboard and enter (or set) button, and also displays the current frequency and the new value being input prior to the enter button being pressed. In this embodiment the channel module 34 does not allow the same frequency to be allocated to more than one channel. In this embodiment the following optional feature is implemented: frequency values may be input in either Hz or MHz -these are both accepted, and if a value is a decimal, e.g. 123.45, it is assumed to be MHz, whereas when a whole number is input, e.g. 123450000, is assumed to be Hz.
In this embodiment, the range of allowable frequencies (in Hz) far exceeds that of any single real world radio. This flexibility allows the DIS Radio to simulate a wide variety of radio networks, and has the added effect of allowing "short" or "memorable" frequencies (e.g. "101") to be used for channels which do not require a realistic frequency to operate, for example those used for "behind the scenes" technical chatter.
As mentioned earlier above, when a user presses either the volume level icon 66 or the volume screen select icon 68, the volume screen 110 is displayed. More particularly, a volume screen 110 corresponding to the particular channel whose volume level icon 66 or volume screen select icon 68 was pressed is displayed. By way of example, Figure 6 is a schematic illustration (not to scale) of the volume screen 110 of the channel whose name is "GOLD3". In this embodiment the GUI format of the volume screen 110 is provided such that the following variables may be set: (i) "volume level" -a volume level for the audio that is output to the user; and (ii) "volume balance" -a relative volume balance between the left and right audio outputs that are output to the user (e.g. to the left and right ears of the user's headphone set).
(iii) "feedback level" (which may also be termed "sidetone level" -a volume level for playing the user's own transmissions back to themselves. In this embodiment this volume applies to transmissions on all available channels. This feature is particularly advantageous for Air Traffic Controllers who typically expect hear their own transmissions. However, a further advantage is that other users may lower the level, including completely, using for example the controls described below.
Any appropriate GUI layout may be employed to allow the respective volume level, volume balance, and feedback level variables to be set and to have their values displayed. In this embodiment, and referring to Figure 6, a volume level indication icon arrangement 112 is provided and comprises a value bar 114 showing the current volume level, a decrease button 116 and an increase button 118, these buttons 116 and 118 being for a user to decrease or increase the current volume level. Also in this embodiment, and again referring to Figure 6, a volume balance indication icon arrangement 122 is provided and comprises a value bar 124 showing the current volume balance position, a decrease button 126 and an increase button 128, these buttons 126 and 128 being for a user to decrease or increase the level of the left ear output compared to the right ear output. Also in this embodiment, and again referring to Figure 6, a feedback/sidetone level indication icon arrangement 132 is provided and comprises a value bar 134 showing the current feedback/sidetone level, a decrease button 136 and an increase button 138, these buttons 136 and 138 being for a user to decrease or increase the current feedback/sidetone level. In this embodiment the volume level, volume balance and feedback level controls are displayed on a separate screen in order to de-clutter the first screen 62, however this may not be the case and in other embodiments the plurality of volume controls for every channel may be displayed on the first screen 62.
Responding to input selections for the volume level, the volume balance, and the feedback/sidetone level, including implementing corresponding audio outputs at the selected levels and balances, and displaying their values on the first screen 62 and the volume screen 110, is implemented by the volume module 34.
The functions implemented in this embodiment by the chat module 40, the configuration module 42, the fade module 44, and the cut-out module 46 will now be described.
The chat module 40 implements text-based messaging between entities.
The messages may be transmitted and received by the primary entities 8 and/or the secondary entities 10. However, typically, pilot's undergoing training and instruction will not tend to take part in text-based messaging, whereas in contrast this may be particularly useful for entities operated by controllers of the pilot instruction/training, and also for technical support entities. In this embodiment, the text-based messaging enables messages to be sent to one specific entity or to all of the entities participating in the simulation. All the messages that are sent and received are displayed in the order in which they were sent or received. In other embodiments, a message may be sent to one or more particular identified other entities (i.e. a subset of all the participating entities), or may be sent to all entities involved in a simulation exercise.
One possible use of the messaging arrangement is to send ping messages to determine the presence of other entities and/or to determine a message return time (and hence determine, if desired, network latency affecting overall simulation performance).
The configuration module 42 implements configuration functions. For example, in this embodiment, the channel frequencies are specified as an initial state in a configuration file, implemented for example as an Extensible Markup Language (XML) document. In some embodiments, changes that are then made during the simulation can then easily be stored and accommodated.
The fade module 44 implements an indication fade mode to some or all of the above described indications (for example the indications consisting of highlighting or lighting of a transmitting icon 72 or a receiving icon 74). Under the fade mode, when an indication is to be switched off, the indication is reduced to zero over a period of time, rather than being switched off substantially instantaneously. For example, if an icon when highlighted is "lit" with a given brightness, when the indication is to be removed, the brightness may be reduced back down to its normal "off' background level over a period of, for example, ten seconds. The reduction may be continuous or may alternatively step down through one or more decreasing discrete brightness levels. The fade mode tends to allow the pilot to notice indications he or she has missed due to distractions arising from the exercise/training environment, in particular when such distractions arise due to the differing circumstances of a simulation compared to a real flight, and yet more particularly when such distractions arise due to the added complexity provided by the per-channel variations, increased flexibility and increased features provided by at least some embodiments. Thus the fade mode tends to advantageously mitigate the disruptive effect to a pilot of the simulation environment and process compared to a real flight environment.
The cut-out module 46, in co-operation with the PU-activate module 38, implements a function in which if the user presses the PTT icon 76 but then fails to speak, after a predetermined time the cut-out module 46 cuts out the talk facility, i.e. withdraws the voice input capability. Typically the cut-out function will only be implemented if the overall system has a sufficiently good audio quality to give reliable measurement of lack of speaking input from the user who has pressed the PU icon 76. This cut-out functionality may be implemented in any appropriate manner. In some embodiments, it is implemented as described in the following paragraph.
The cut-out module 46 is an optional enhancement that reduces noise in the audio received by a user. This is achieved by examining the average volume of every sample of audio data as it is recorded, and by ignoring any sample which does not meet or exceed a predetermined (or otherwise determined) minimum volume threshold. Dropped audio samples never leave the sender and are not transmitted over the network. In some embodiments, it is only the audio data which is moderated; the radio state is not affected and will continue to advertise that the radio is on and transmitting until the PTT is released. In some embodiments, when enabled, the volume check is effectively active all the time, from the instant PIT is clicked, to the moment it is released, i.e. with volume checking enabled. If the PTT is clicked but nothing spoken, no data is sent at all. In some embodiments, the volume threshold is set in the configuration XML file and is tuned for the audio input equipment in use, and for the audio quality settings in use.
In some embodiments the first screen 62 and other screens may be displayed on a small display device which would be dedicated to displaying the radio, the size of which could be suitably matched to the application. In some embodiments the dedicated device is a touch sensitive screen but this does not have to be the case.
In some embodiments, the number of channels, and/or the number of variables that may be controlled for each channel (for example volume balance between right and left ears, mute capability, and so on), is specifically made higher than would be the case in the real world system that is being simulated.
In particular, in some embodiments a pilot may be provided with more channels and/or more variables, thereby allowing the flexibility and other benefits of a training or practise simulation exercise to be increased.
In some embodiments, a further advantageous feature that is provided is that the PTT function is controlled by a simple input mechanism, either in addition to or instead of the PTT icon 76 described earlier above. One possibility is for the PTT function to be controlled by pressing of a space bar or other large key area on a keyboard. Another possibility is for the PTT function to be controlled by pressing of a foot pedal. Corresponding possibilities may in addition or instead be used to control the mute/unmute function. For all the options described in this paragraph. if desired the PIT icon 76 may still be employed to display which channel the user's PIT and/or mute/unmute input will be applied to.
The above embodiments may be implemented using any appropriate software and data processing techniques. One possibility is as follows. A commercially available DIS interface module is employed (for example, one such commercially available DIS interface module is "Open-DIS-Lite "An Open Source Implementation of the Distributed Interactive Simulation protocol" which may be obtained via http://open-dis.sourceforge.net/Open-DlS.html. DIS packets are put into local software objects (this may be implemented using JAVA, or any other appropriate programming language), which are then employed within the simulated radio.
In the current embodiment and as per DIS, each audio packet is associated with a "transmitter" (or transmitter and receiver" object) which contains data such as the frequency in use, and the radio operational state. In this embodiment, each instance of the DIS radio emits a transmitter object (or transmitter and receiver object) for every radio channel which is configured. In other embodiments this need not be the case. In this embodiment the transmitter object (or transmitter and receiver object) is updated when a property such as frequency in use or transmitter state (on, on & transmitting, off) is changed. In the DIS specification, each transmitter object (or transmitter and receiver object) is "attached" to a physical entity in the simulation. In this embodiment the entity is provided by the radio simulation, however in other embodiments this need not be the case. The transmitter (or transmitter and receiver) adopts the location of the entity to which it is attached. Both the transmitter (or transmitter and receiver) and the attached entity can have their type specified using the standard DIS identifier object, which allows other simulation participants to look-up the type of entity and radio being simulated In some embodiments, a further advantageous feature that is provided is that computer generated (or operator generated) unmanned aircraft and/or other types of entities may be employed in the simulation in addition to the aircraft and other entities being controlled by pilots and other types of users (e.g. mission controllers), to provide additional complexity to the simulation.
In the above embodiments, the particular user interface implementations described above are described as being used by the particular simulator systems described above, in particular the different simulator functionalities and modules described above. However, this need not be the case, and in other embodiments the particular user interface implementation embodiments described above may be used by any other types of simulator systems, including simulator systems that do not include the functionalities and modules of the simulator systems described above.
Apparatus, including the primary entities 8 and the secondary entities 10, for implementing the above arrangements, and performing the processes described above, may be provided by configuring or adapting any suitable apparatus, for example one or more computers or other processing apparatus or processors, and/or providing additional modules. The apparatus may comprise a computer, a network of computers, or one or more processors, for implementing instructions and using data, including instructions and data in the form of a computer program or plurality of computer programs stored in or on a machine readable storage medium such as computer memory, a computer disk, ROM, PROM etc., or any combination of these or other storage media.

Claims (15)

  1. CLAIM S1. A user interface for a simulated wireless arrangement, wherein the simulated wireless arrangement is for communicating audio content in a distributed simulation process, wherein the distributed simulation process is a flight operation and control exercise performed by a plurality of simulation entities (8, 10) each representing a real-world entity, at least some of the real-world entities being from one or more of the following group of entity types: i) vehicles, ii) mission controllers, iii) airspace controllers; the user interface comprising: audio input and output means (24, 260) arranged for a human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to input and receive output of speech during the distributed simulation process; and simulated wireless control input means (62, 90, 110), for use by the human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to control the simulated wireless arrangement; the simulated wireless control input means comprising screen icons (64, 68, 70 72, 74, 76) adapted for the human operator to press, the icons (64, 68, 72, 74, 76) allowing control input related to one or more of the following group of functionalities of the simulated wireless arrangement: i) push-to-talk; ii) selection between a plurality of simulated wireless channels; iii) selection of respective simulated frequencies for the plurality of simulated wireless channels.
  2. 2. A user interface according to claim 1, wherein the user interface is defined as a further simulation entity forming a further one of the plurality simulation entities defined for the distributed simulation process, arranged for the human operator to thereby control at least two of the simulation entities, one -20 -being the user interface and the other being an associated one of the plurality of simulation entities (8) that simulates a real-world entity from the following group of entity types: i) vehicles, ii) mission controllers, Hi) airspace controller.
  3. 3. A user interface according to claim 1 or claim 2, comprising further icons (116, 118, 126, 128) allowing volume control input related to one or more of the following group of volume control functionalities of the simulated wireless arrangement: i) volume level control, ii) volume balance between left and right ear control, iii) feedbacklsidetone level control.
  4. 4. A user interface according to any of claims 1 to 3, comprising further icons allowing text communication input.
  5. 5. A user interface according to any of claims I to 4, arranged to allow a larger selection of input control possibilities compared to what is available in the real-world entity that the simulation entity (8) is simulating in the distributed simulation process.
  6. 6. A user interface according to any of claims 1 to 5, wherein the simulation entity (8) is simulating an aircraft, and the human operator is performing simulated piloting of the aircraft.
  7. 7. A user interface according to any of claims 1 to 6, wherein the distributed simulation process is performed according to a Distributed Interactive Simulation, DIS, as issued by the Simulation Interoperability Standards Organization, SISO.
  8. 8. A method for a simulated wireless arrangement, wherein the simulated wireless arrangement is for communicating audio content in a distributed -21 -simulation process, wherein the distributed simulation process is a flight operation and control exercise performed by a plurality of simulation entities (8, 10) each representing a real-world entity, at least some of the real-world entities being from one or more of the following group of entity types: i) vehicles, ii) mission controllers, iii) airspace controllers; the method comprising employing a user interface to implement: during the distributed simulation process, inputting and receiving output of speech via audio input and output means (24, 260) arranged for a human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to provide the speech for input and receive the audio output; and simulated wireless control input means (62, 90, 110), for use by the human operator, whilst the human operator is operating the one of the simulation entities (8, 10) in the distributed simulation process, to control the simulated wireless arrangement; the simulated wireless control input means comprising screen icons (64, 68, 70 72, 74, 76) adapted for the human operator to press, the icons (64, 68, 72, 74, 76) allowing control input related to one or more of the following group of functionalities of the simulated wireless arrangement: i) push-to-talk; ii) selection between a plurality of simulated wireless channels; iii) selection of respective simulated frequencies for the plurality of simulated wireless channels.
  9. 9. A method according to claim 8, wherein the user interface is defined as a further simulation entity forming a further one of the plurality simulation entities defined for the distributed simulation process, arranged for the human operator to thereby control at least two of the simulation entities, one being the user interface and the other being an associated one of the plurality of simulation entities (8) that simulates a real-world entity from the following group of entity types: i) vehicles, ii) mission controllers, Hi) airspace controller. -22 -
  10. 10. A method according to claim 8 or claim 9, wherein the user interface comprises further icons (116, 118, 126, 128) allowing volume control input related to one or more of the following group of volume control functionalities of the simulated wireless arrangement: i) volume level control, H) volume balance between left and right ear control, iii) feedbacklsidetone level control.
  11. 11. A method according to any of claims 8 to 10, wherein the interface comprises further icons allowing text communication input.
  12. 12. A method according to any of claims 8 to 11, wherein the method comprises the human operator being provided with a larger selection of input control possibilities compared to what is available in the real-world entity that the simulation entity (8) is simulating in the distributed simulation process.
  13. 13. A method according to any of claims 8 to 12, wherein the simulation entity (8) is simulating an aircraft, and the human operator is performing simulated piloting of the aircraft.
  14. 14. A program or plurality of programs arranged such that when executed by a computer system or one or more processors it/they cause the computer system or the one or more processors to operate in accordance with the method of any of claims 8 to 13.
  15. 15. A machine readable storage medium storing a program or at least one of the plurality of programs according to claim 14.
GB1417329.8A 2014-10-01 2014-10-01 Simulation system user interface Withdrawn GB2530764A (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
GB1417329.8A GB2530764A (en) 2014-10-01 2014-10-01 Simulation system user interface
US15/515,192 US20170221382A1 (en) 2014-10-01 2015-09-25 Simulation system user interface
PCT/GB2015/052791 WO2016051143A1 (en) 2014-10-01 2015-09-25 Simulation system user interface
EP15781982.2A EP3201898A1 (en) 2014-10-01 2015-09-25 Simulation system user interface
AU2015326570A AU2015326570A1 (en) 2014-10-01 2015-09-25 Simulation system user interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1417329.8A GB2530764A (en) 2014-10-01 2014-10-01 Simulation system user interface

Publications (2)

Publication Number Publication Date
GB201417329D0 GB201417329D0 (en) 2014-11-12
GB2530764A true GB2530764A (en) 2016-04-06

Family

ID=51901433

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1417329.8A Withdrawn GB2530764A (en) 2014-10-01 2014-10-01 Simulation system user interface

Country Status (5)

Country Link
US (1) US20170221382A1 (en)
EP (1) EP3201898A1 (en)
AU (1) AU2015326570A1 (en)
GB (1) GB2530764A (en)
WO (1) WO2016051143A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MX2017004400A (en) * 2017-04-04 2018-11-09 Centro De Investigacion Y De Estudios Avanzados Del Instituto Politecnico Nac Method and system for generating stationary and non-stationary channel realisations of arbitrary length.

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
UA16927U (en) * 2006-07-04 2006-08-15 Training system for helicopter crews
WO2008087823A1 (en) * 2007-01-15 2008-07-24 Shinmaywa Industries, Ltd. Training flight simulator
RU2367026C1 (en) * 2008-02-05 2009-09-10 Общество с ограниченной ответственностью "Центр тренажеростроения и подготовки персонала" Simulator for training pilots to fly stike helicopters and air ordinance delivery
JP2009212636A (en) * 2008-03-03 2009-09-17 Japan Radio Co Ltd Voice line simulation system
CN101702275A (en) * 2009-08-20 2010-05-05 达新宇 Short-wave digital radio station network simulated training system
US20110207091A1 (en) * 2010-02-23 2011-08-25 Arinc Incorporated Compact multi-aircraft configurable flight simulator

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208897A (en) * 1990-08-21 1993-05-04 Emerson & Stern Associates, Inc. Method and apparatus for speech recognition based on subsyllable spellings
US6053736A (en) * 1997-10-17 2000-04-25 Southwest Research Institute Interactive training system for AWACS weapons directors
US6952590B2 (en) * 2002-05-06 2005-10-04 The United States Of America As Represented By The Secretary Of The Air Force Apparatus and method for a multi-channel, multi-user wireless intercom
US20060235698A1 (en) * 2005-04-13 2006-10-19 Cane David A Apparatus for controlling a home theater system by speech commands
WO2008056359A2 (en) * 2006-11-09 2008-05-15 Israel Aerospace Industries Ltd. Mission training center instructor operator station apparatus and methods useful in conjunction therewith
US20100266991A1 (en) * 2009-04-16 2010-10-21 Redbird Flight Simulations, Inc. Flight simulation system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
UA16927U (en) * 2006-07-04 2006-08-15 Training system for helicopter crews
WO2008087823A1 (en) * 2007-01-15 2008-07-24 Shinmaywa Industries, Ltd. Training flight simulator
RU2367026C1 (en) * 2008-02-05 2009-09-10 Общество с ограниченной ответственностью "Центр тренажеростроения и подготовки персонала" Simulator for training pilots to fly stike helicopters and air ordinance delivery
JP2009212636A (en) * 2008-03-03 2009-09-17 Japan Radio Co Ltd Voice line simulation system
CN101702275A (en) * 2009-08-20 2010-05-05 达新宇 Short-wave digital radio station network simulated training system
US20110207091A1 (en) * 2010-02-23 2011-08-25 Arinc Incorporated Compact multi-aircraft configurable flight simulator

Also Published As

Publication number Publication date
AU2015326570A1 (en) 2017-04-20
US20170221382A1 (en) 2017-08-03
GB201417329D0 (en) 2014-11-12
EP3201898A1 (en) 2017-08-09
WO2016051143A1 (en) 2016-04-07

Similar Documents

Publication Publication Date Title
US20170221375A1 (en) Simulation system
US20180028907A1 (en) Information processing method, terminal, and computer storage medium
EP3466113B1 (en) Method, apparatus and computer-readable media for virtual positioning of a remote participant in a sound space
CN111225230B (en) Management method and related device for network live broadcast data
CN106533711B (en) Multimedia conference method and device
CN112165648B (en) Audio playing method, related device, equipment and storage medium
CN110035250A (en) Audio-frequency processing method, processing equipment, terminal and computer readable storage medium
CN108513088B (en) Method and device for group video session
JP2018524894A (en) Electronic device for controlling industrial communication device and industrial communication device
US6987480B1 (en) Voice communications control system and method
US9621258B2 (en) Bi-directional communication for control of unmanned systems
US20170221382A1 (en) Simulation system user interface
CN109473117B (en) Audio special effect superposition method and device and terminal thereof
US11825238B2 (en) Videoconference system, method for transmitting information and computer program product
US20230078804A1 (en) Online conversation management apparatus and storage medium storing online conversation management program
US11825026B1 (en) Spatial audio virtualization for conference call applications
WO2022253856A2 (en) Virtual interaction system
CN107113361B (en) Central unit for a conference system
US8019824B2 (en) Remotely operating computer software applications using low bandwidth
US7466827B2 (en) System and method for simulating audio communications using a computer network
US20240031758A1 (en) Information processing apparatus, information processing terminal, information processing method, and program
US20070041547A1 (en) Multiparty call of portable devices with party positioning identification
US20230370801A1 (en) Information processing device, information processing terminal, information processing method, and program
US20220329959A1 (en) Apparatus for providing audio data to multiple audio logical devices
KR20230015302A (en) Information processing device, information processing method and program

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)