Classifications

• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B9/00—Simulators for teaching or training purposes
  • G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
  • G09B9/08—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of aircraft, e.g. Link trainer
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B19/00—Teaching not covered by other main groups of this subclass
  • G09B19/16—Control of vehicles or other craft
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
  • G09B9/00—Simulators for teaching or training purposes

Definitions

• the invention relates to computerized systems for integrated procedure training and, in particular, to an arrangement of touch-sensitive display surfaces for simulating a control station of a complex system, in order to provide students with a tool for self-paced learning or practicing integrated procedures required to operate or maintain the complex system.
• a condition of a complex system is generally monitored and controlled at one or more control/maintenance stations.
• Each of the control/ maintenance stations usually includes a plurality of components having respective control panels that display state information, and provide an interface for issuing commands governing one or more aspects of the complex system.
• Most often each of the control panels has numerous switches, buttons, dials, keypads etc. for entering the control commands, along with multiple display elements.
• Learning integrated procedures therefore involves not only learning a correct sequence of control commands needed to effect the procedure, what to do in the event of an error, at which points in the procedure displays should be consulted, etc., but also physical motions needed to effect control, read the displays, etc.
• 3-dimensional training stations that faithfully reproduce the spatial arrangements and behavior of the control panels at the control/ maintenance station are used to imbed a student in the ambience of the complex system, to visualize/experience situations in this large complex system, to practice the physical motion component of the procedures as well as to obtain an orientation in space of where all the panels and displays are located.
• the 3-dimensional training station is identical
• Another object of the invention is to provide an apparatus for permitting self-paced system knowledge and integrated procedure training for complex systems using self-paced courseware.
• the invention provides a three- dimensional apparatus for training a student 'to learn systems and perform integrated procedures required to operate or maintain a complex system
• the apparatus comprising touch-sensitive display surfaces spatially arranged so that representations of the control panels displayed on the touch-sensitive display surfaces are arranged in a three-dimensional space similarly to real control panels of the complex system, C H A R A C T E R I Z E D by: a computing machine adapted to accept student input from the touch-sensitive display surfaces, communicate the student input to a full-scope simulation of the complex system, and receive change of condition updates from the full-scope simulation, which are used to dynamically update the representations of the control panels.
• the touch-sensitive display surfaces are preferably touch screens, that are supported in their spatial arrangement by a support structure having a plurality of display support points for captively holding the touch-sensitive display surfaces.
• the support points are preferably adapted to be reoriented and repositioned so that the touch-sensitive display surfaces can be arranged in more than one configuration.
• the apparatus can therefore be used for training integrated procedures for control stations of a set of complex systems, and can therefore adapt to changes in the control panels used in the complex systems. Any one supporting member of the support structure can be adapted to be reconfigured, in order to change relative positions of the touch-sensitive display surfaces, so that the touch-sensitive display surfaces can be arranged as control panels of different complex systems .
• the invention also provides a method for learning systems and providing integrated procedure training to permit a student to practice integrated procedures required to operate or maintain a complex system, comprising steps of arranging a plurality of touch- sensitive display surfaces on a 3-dimensional support structure in a spatial arrangement similar to a spatial arrangement of control panels of the complex system, and displaying images of the control panels on the display surfaces and running a full-scope simulation of the complex system, C H A R A C T E R I Z E D by: passing student inputs representative of manipulations of control instruments sensed by the touch-sensitive display surfaces to the full-scope simulation; receiving data from the full-scope simulation representing a condition of the full-scope simulation that affects the representations of the control panels on the touch- sensitive display surfaces; and updating the representations of the control panels, as required, in response to receiving the data.
• an image displayed on the touch screens is controlled by software, and so each touch screen can be configured to display different components, having respective different interfaces, for different complex systems.
• This capability makes the apparatus a versatile training station.
• the low cost of the touch screens and standard communications and computing devices permit the data provided by the very expensive full-scope simulation server to be accessed from substantially anywhere via a network.
• a remote or local instructor can access conditions of a simulated complex system to monitor the training of the student, in free- play or with the advantageous use of self-paced courseware.
• FIG. 1 is a schematic diagram illustrating an integrated procedure training apparatus in accordance with an embodiment of the invention
• FIG. 2 is a schematic diagram illustrating another embodiment of the apparatus shown in FIG. 1 featuring articulated joints that make the apparatus configurable;
• FIG. 3 is a schematic diagram illustrating another embodiment of an apparatus in accordance with the invention.
• FIG. 4 is a schematic diagram illustrating a computer system for providing real-time graphical simulation information to an apparatus in accordance with an embodiment of the present invention
• FIG. 5 is a schematic diagram illustrating a variation of the computer system for remote delivery of the training procedure illustrated in FIG. 4;
• FIG. 6 is a schematic diagram illustrating a computer system for delivering the training without courseware.
• the present invention provides a method and apparatus that permits complex system control, operations, and maintenance personnel to be trained, or to practice, integrated procedures required to control, operate or maintain the complex system.
• the apparatus includes spatially arranged touch-sensitive display surfaces that display at least parts of interactive graphic representations of control panels of the complex system, and one or more computing machines for exchanging data between the touch-sensitive display surfaces and a full-scope simulation server.
• operator and maintenance personnel are trained to perform integrated procedures in a three-dimensional environment that closely mimics the spatial arrangement of the real control panels of the complex system thus permitting the personnel to acquire "muscle memory" associated with the movements and mental models developed by performing the integrated procedures.
• control/maintenance station that can be simulated by an apparatus in accordance with the invention is a cockpit of an aircraft. Both ground crew and flight crew must learn systems, perform integrated procedures to test aircraft systems; perform routine maintenance operations, inspections, and modifications; and, practice in-flight emergency as well as standard operating procedures, etc. as is well known in the art.
• FIG. 1 is a schematic diagram illustrating an integrated procedure training apparatus 15 in accordance with one embodiment of the invention.
• the integrated procedure apparatus 15 is configured to serve as a cockpit training apparatus. Consequently, it includes two touch-sensitive display surfaces 16a, 16b of an overhead of a cockpit, two touch-sensitive display surfaces 18a, 18b representative of a pedestal of a cockpit, and three touch-sensitive display surfaces 20a, 20b and 20c representative of a main instrument panel of the cockpit.
• the touch-sensitive display surfaces may be, for example, touch-sensitive liquid crystal displays (LCDs), or rear projection screens having a display surface covered with a touch-sensitive element of a type well known in the art.
• LCDs touch-sensitive liquid crystal displays
• the integrated procedure training apparatus 15 preferably further includes at least one speaker 26 that may be used for simulated audible warnings of the complex systems, to narrate courseware instruction to facilitate integrated procedure training, or to permit an instructor to provide verbal instructions to one or more students operating the integrated procedure apparatus, or the like.
• the integrated procedure training apparatus 15 preferably further includes an associated projector 28 that is used to project visual images on a projection screen or backing wall 30.
• the projector 28 and the screen 30 are used, for example, to display system schematics, to display courseware text or instructions, or display text providing suggestions for remedial action if a student has incorrectly performed a procedure, or to display any other multi-media material used for training.
• the projector may be used to display environment, in a case where the integrated procedure training apparatus is configured for flight crew training, or any other mobile system.
• the projector 28 may ' be used to project visual images that simulate flight, or traversed terrain, or the like, as appropriate to the system being simulated.
• the procedure training apparatus further includes an operator station 32 which may be used by a student or an instructor to input control data to a full-scope simulation that runs in conjunction with the integrated procedure training apparatus 15, or to select a course if the apparatus 15 is being operated in a courseware mode.
• the operator station 32 includes, for example, a desktop computing system 32a that supports a display screen 32b, a keyboard 32c and a pointing device such as a mouse 32d. The operator station will be explained below in more detail with reference to FIGs . 4 and 6.
• the operator station may also be used, rather than projector 28 and the projection screen 30, to display information related to courseware, and the like, while a student is training at the integrated procedure apparatus 15.
• the control data entered using the operator station 32 • is used to condition a full-scope simulation used during training.
• the control data is used, for example to specify fuel load, operating conditions, and other variables used to condition the full-scope simulation to simulate conditions in which the training or practice are to be effected.
• the integrated procedure training apparatus 15 can be further enhanced by adding other 3-dimensional elements, such as the hardware equivalent of the main systems of the complex system.
• the integrated procedure training apparatus 15 may be enhanced by the addition of an auto-pilot control panel, a flight management system (FMS) control display unit (CDU) , throttles and other control panels, so that tactile feedback and mental models are acquired during integrated procedure learning and practice.
• FMS flight management system
• CDU control display unit
• a structure 22 of the integrated procedure training apparatus 15 supports the touch-sensitive display surfaces 16a-20c in their spatial arrangement.
• the structure 22 includes two base members 24 that support the apparatus and display support points (not shown) to which the touch-sensitive display surfaces are affixed.
• the structure 22 rigidly supports the touch- sensitive display surfaces against forces that may be applied by the student while the apparatus 15 is in use.
• the purpose of the integrated procedure training apparatus 15 configured as shown in FIG. 1 is to provide systems and integrated procedure training for maintenance and flight crews . Such training may be monitored or evaluated by an instructor.
• FIG. 2 is a schematic diagram of another embodiment of the integrated procedure training apparatus in accordance with the invention.
• the support structure 22 includes one or more articulated joints 36 to permit the integrated procedure training apparatus 35 to be reconfigured to imitate spatial relations of control panels in various aircraft, or other complex systems. While articulated joints 36 are illustrated between each of the respective touch- sensitive display surfaces, it should be understood that the integrated procedure training apparatus 35 shown in FIG. 2 may include more, or fewer, articulated joints.
• articulated joints on the overhead display surfaces 16a, 16b and between the pedestal display surfaces 18a, 18b are most practical as they permit the pedestal and overhead display surfaces to be configured in landscape or portrait configurations to more closely replicate the spatial arrangement of control surfaces in various aircrafts.
• the respective display surfaces 16a, to 20c may likewise be supported by slidable mounts (not shown) to permit the respective display surfaces to be moved longitudinally in either direction along the support structure 22 to facilitate reconfiguration .
• Integrated procedures are procedures that provide a student with knowledge about the complex interrelations between sub-systems of a complex system, because the procedures involve or affect many of the sub-systems.
• Integrated procedures involve interactions with spatially arranged control and display equipment in a 3-dimensional environment that mimics the control/maintenance station of the complex system. Training motor reflexes is an important part of learning integrated procedures, along with building a mental model of each sub-system's behavior and their interrelations.
• touch-sensitive display surfaces may not provide realistic tactile representations of some complex system controls, the students who use apparatus 15, 35 in accordance with the invention learn where to look, move and reach for the required controls and/or information, and in which direction and sequence body movements must be made in order to perform any given integrated procedure.
• FIG. 3 is a schematic diagram of another embodiment of the invention.
• an integrated procedure training apparatus 40 includes a plurality of touch-sensitive display surfaces 42, arranged to simulate a three-dimensional control station of a complex system, such as a nuclear power plant, marine control system, or the like.
• the control station of the simulated complex system are displayed on the display surfaces using interactive graphic representations of the switches, dials, control levers, gauges, and other instruments and information displays that are present on the real control panels in as near to photo-realistic effect as possible. Consequently, operator and maintenance personnel can learn or practice integrated procedures using the training apparatus 40, and acquire the muscle memory and mental models developed by moving around the control station simulated by the apparatus 40.
• the integrated procedure training apparatus 40 is a relatively simple implementation of the invention, the availability of multi-processor computing, and parallel computing systems using networked computing machines makes it practical to develop a very large integrated procedure training apparatus that can be arranged in a three-dimensional space to simulate a control room of a nuclear power plant, or any other very large complex system that can be simulated.
• FIG. 4 is schematic diagram of an integrated procedure training apparatus 40 in accordance with the invention, and client/server computing machines 44 for driving the touch-sensitive display surfaces 42 to display the interactive graphic representations of control panels of a simulated complex system.
• the simulated complex system is a cockpit of an aircraft. Consequently, aside from the touch- sensitive display surfaces 42, the integrated procedure training apparatus further includes the projector 28, as described above with reference to FIG. 1, and additional hardware 56, including a control display unit (CDU) which is a component of modern aircraft that is used by the flight and maintenance crew to input control data such as fuel load, etc.
• the additional hardware 56 further includes a autopilot control panel, that is used to control automatic flight.
• the integrated procedure training apparatus 40 is connected to the client/server computing machines in a manner well known in the art.
• Bi-directional communications connections permit display data 47 to be sent from a run-time engine (RTE) for controlling the interactive graphic representations of the simulated control panels, and courseware information displayed by the projection system, permit the touch-sensitive display surfaces 42 to return student inputs sensed by the touch- sensitive elements associated with the respective display surfaces 42.
• the student inputs may likewise be generated by inputs to the additional hardware 56, as described above.
• the RTE 46 receives the display data from the full-scope simulation 48.
• the RTE may also receive display data from self-paced courseware 50, which may generate information text or instructions that is displayed over a portion of the simulated control panels or on the projection screen 30.
• the visual projector 28 can provide a visual scene to enhance the integrated procedure training apparatus. This is done by synchronizing the full scope simulation status with the visual database.
• FIG. 5 is a schematic diagram of another embodiment of the integrated procedure training apparatus 40 in accordance with the invention.
• client computing machines 44a drive the x touch-sensitive display surfaces 42 to display the interactive graphic representations of control panels of a simulated complex system.
• the full-scope simulation is, however, supported by remote server computing machine (s) 44b.
• the simulated complex system is also a cockpit of an aircraft, and therefore has all the features of the embodiment described above with reference to FIG. 4.
• This architecture is similar to the system described in Applicant's co-pending United States Patent application filed concurrently herewith and entitled System and Method for Distance Learning of Systems Knowledge and Integrated Procedures Using a Real-Time, Full-Scope Simulation, the specification of which is likewise incorporated herein by reference.
• the server computing machine (s) include a session manager 68, which controls access to the full scope simulation as described in the above-referenced co- pending patent application.
• An optional learning management system (LMS) is used to track and evaluate student training and maintain student records, as well as to launch courseware.
• a courseware server 66 stores courseware that is adapted to be run by one or more of the RTE(s) • 46-1, 46-n.
• the client computing machine (s) 44a support as many RTE(s) 46-1, 46-n as required to control the respective display surfaces 42 to a satisfactory performance standard and to optionally drive a projector.
• Each RTE controls the interactive graphical representations displayed by one or more of the touch-sensitive display surfaces 42 and/or projector.
• each RTE 46 subscribes to simulator variables required to dynamically refresh the control panel display (s) for which the RTE 46 is responsible.
• the client computing machine (s) 44a likewise support a hardware RTE 62 adapted to communicate with the additional hardware 56 to accept user input through the CDU or the autopilot control panel, translate to data into appropriate data elements and transfer the data elements to the full-scope simulation 48 via the network 60.
• FIG. 6 is a schematic diagram of another client/server computing machine architecture designed to support an integrated procedures training apparatus 40 in accordance with the invention.
• This embodiment of the invention is specifically designed for use in instructor- led or free-play mode.
• the integrated procedures training apparatus 40 is identical to the one described above with reference to FIGs. 4 and 5.
• the client/server computing machines 44 support one or more RTE(s), as explained above with reference to FIG. 6.
• the RTE(s) send display data 47 to the respective touch-sensitive display surfaces 42 or projector, and receive student inputs 49 from the touch-sensitive display surfaces 42.
• the display data is retrieved from the full-scope simulation 48 by the receptive RTE(s), as described above.
• the RTE(s) 46 pass the student inputs to the full-scope simulation, which changes a s'tate of the simulation and provides display data to update the interactive graphic representations displayed by the touch-sensitive displays 42.
• the operator station 32 is used by instructors or students to condition the full-scope simulation for an instructor-led or a free-play learning or practice session.
• the simulation interface 52 the user interface to the simulation control as described above, provides a level of abstraction that facilitates the conditioning of the full-scope simulation by students and/or instructors who are not familiar with an architecture of operation of the full-scope simulation.
• the student After the student has conditioned the full-scope simulation as desired for the practice or training session, the student operates the integrated training apparatus 40 manipulating virtual switches, levers and other simulated control mechanisms displayed on the touch-sensitive display surfaces 42, to control the simulated complex system.
• the full-scope simulation 48 behaves substantially identically to the real system, had the same inputs been received from the real control panels of the real system. This permits a student or a researcher to use the system in accordance with the invention to practice emergency procedures, try experimental procedures, or develop new procedures for efficiency, disaster recovery or the like, without endangering the student, the public or the simulated equipment .
• the invention therefore provides a beneficial training apparatus that permits safe, efficient and economical integrated procedure training, experimentation and development.
• the apparatus also permits experienced operator and maintenance personal to practice integrated procedures in a supervised (courseware) or unsupervised

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Business, Economics & Management (AREA)
• Physics & Mathematics (AREA)
• Educational Administration (AREA)
• Educational Technology (AREA)
• General Physics & Mathematics (AREA)
• Entrepreneurship & Innovation (AREA)
• Aviation & Aerospace Engineering (AREA)
• Electrically Operated Instructional Devices (AREA)
• Controls And Circuits For Display Device (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=33520292

Family Applications (1)

Country Status (4)

• 2002
  • 2002-05-07 CA CA002483440A patent/CA2483440A1/en not_active Abandoned
• 2003
  • 2003-05-07 AU AU2003229430A patent/AU2003229430A1/en not_active Abandoned
  • 2003-05-07 CN CN 03810976 patent/CN1653502A/zh active Pending
  • 2003-05-07 EP EP03722130A patent/EP1502248A2/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events