JP2022046275A - Conductor simulation training system - Google Patents

Abstract

To provide a conductor simulation training system in which safety confirmation to be carried out by a conductor can be effectively learned.SOLUTION: In a conductor simulation training system 1000, a computer includes: a simulation unit 210 for simulating conductor tasks related to departures and arrivals of virtual trains from/to a station involving opening/closure of train doors and passengers getting on and off based on operation of an opening/closing operation button in a virtual reality space, according to a given scenario; a VR image generating unit 220 for generating VR images to be displayed in a VR google during the simulation, on the basis of a tracking visual line according to a visual line tracking unit; a gazing object detection unit 230 for detecting a gazing object in the virtual reality space of a user, on the basis of the tracking visual line and the VR images; and an abnormality generation processing unit 232 for generating given abnormality event simulation during the simulation, in the case that abnormality generating conditions based on the gazing object have been satisfied.SELECTED DRAWING: Figure 12

Description

The present invention relates to a conductor simulation training system for a user to perform a conductor simulation training.

There is a training device to become a conductor or to improve the training as a conductor. For example, a simulated platform prepared for training includes a training device including a scene display device and a stop position target display device (see Patent Document 1 and Patent Document 2). The scene display device displays the front scene image that will be visible from the crew room of the simulated train in the situation prepared for training, and the stop position target display device is linked with the front scene image. An image is displayed in which the stop position in the situation moves.

Japanese Patent Application Laid-Open No. 2003-233299 Japanese Patent Application Laid-Open No. 2003-330356

One of the essential actions that the conductor should perform when arriving at a station is, for example, confirmation of the stop position. In addition, as essential actions that the conductor should perform at the time of departure, for example, there is closing the door of the train and its confirmation. This is a typical example of essential operation, and many other operations are required, and thorough learning is required especially for safety confirmation.

An object to be solved by the present invention is to provide a technique capable of effectively learning the safety confirmation to be performed by the conductor in the conductor simulation training system.

The first invention for solving the above-mentioned problems is a simulated crew room set in which an opening / closing operation button for a train door is installed, a VR (Virtual Reality) goggles worn by a user, and a line of sight that tracks the line of sight of the user. A tracking unit and a control device are provided, and the control device relates to a virtual train station arrival / departure including opening / closing of a train door and boarding / alighting of passengers based on an operation of the opening / closing operation button in a virtual reality space. A simulation unit that simulates the commander's work based on a given scenario, a VR image generation unit that generates a VR image to be displayed on the VR goggles during the simulation based on the tracking line of sight by the line-of-sight tracking unit, and the tracking unit. Given in the simulation when the gaze target detection unit that detects the gaze target in the virtual reality space of the user based on the line of sight and the VR image and the abnormality occurrence condition based on the gaze target are satisfied. It is a driver simulation training system having an abnormality generation processing unit that generates an abnormality event simulation.

According to the first invention, it is possible to generate an abnormal event simulation depending on where the trainee user is looking during the simulation. In that case, the user will deal with the abnormal event related to the abnormal event simulation. According to this, effective training for learning the safety confirmation that the conductor should perform can be realized.

In the second invention, the simulation unit simulates the display of an ITV (Industrial TeleVision) device installed in a home in the virtual reality space, and the abnormality generation processing unit generates the gaze at a given ITV gaze timing. It is a conductor simulation training system of the first invention which determines that the ITV was not detected as a target as a first abnormality occurrence condition.

According to the second invention, the abnormal event simulation can be generated when the user does not visually recognize the ITV device at the ITV gaze timing.

The third invention is the conductor simulation training system of the second invention, wherein the ITV gaze timing includes at least a period of a predetermined number of seconds immediately before the closing operation is performed by the opening / closing operation button.

According to the third invention, the abnormal event simulation can be generated when the user does not visually recognize the ITV device immediately before closing the train door.

The fourth invention further includes a position tracking unit that tracks the position of the user or the VR goggles, and the simulated crew room set is configured to be able to enter and exit from a simulated entrance / exit. The VR image generation unit simulates from the timing when the train reaches the platform of the station where the train is scheduled to stop until the train leaves the station, and the VR image generation unit is based on the tracking line of sight and the tracking position by the position tracking unit. A VR image is generated, and the abnormality generation processing unit determines as a second abnormality occurrence condition that the train side surface is not detected as the gaze target at a given train side gaze timing, the first to third. It is a train operator simulation training system of any of the inventions.

According to the fourth invention, the abnormal event simulation can be generated when the user does not visually recognize the train side surface at the train side surface gaze timing.

In the fifth aspect of the invention, the gaze target detection unit can detect the gaze target detection unit as a gaze target for each train side surface region that divides the train side surface in the front-rear direction of the train, and the abnormality generation processing unit is the train continuous in the front-rear direction of the train. This is the conductor simulation training system of the fourth invention, which determines as the second abnormality occurrence condition that the side surface region is not continuously detected as the gaze target.

According to the fifth invention, the abnormal event simulation can be generated when the user does not continuously visually recognize the continuous train side surface region in the front-rear direction of the train.

A sixth aspect of the invention is any of the first to fifth aspects, wherein the abnormal event simulation is a simulation of the occurrence of a passenger rushing into the train and / or the occurrence of a passenger or an object being caught in the train door. This is the conductor simulation training system of the invention.

According to the sixth invention, it is possible to generate a simulation of the occurrence of a passenger rushing into a train as an abnormal event simulation. In addition, a simulation of the occurrence of passengers or objects being caught in a train door can be generated as an abnormal event simulation.

The figure which shows the system configuration example of the conductor simulation training system. The figure which shows the setting example of the training ground of a conductor simulation training system. The figure which shows the example of the virtual reality space controlled by a computer. The figure for demonstrating the record of a user's action in a conductor simulation training system. The figure which shows an example of the recorded content of the gaze target history data. FIG. 5 is an enlarged view of the recorded contents of the side surface of the train in the elapsed time zone shown by the broken line in FIG. The figure explaining the detection of the gaze object about a train object. The figure which shows the presentation example after the simulation (the 1). The figure which shows the presentation example after the simulation (the 2). The figure which shows the presentation example after the simulation (the 3). The figure which shows the presentation example after the simulation (the 4). A functional block diagram showing an example of a functional configuration of a conductor simulation training system. The figure which shows the example of the program and data which a storage part stores. A flowchart for explaining the flow of processing in a computer. Schematic diagram of the training ground of the conductor simulation training system in the modified example from above.

Hereinafter, one embodiment of the present invention will be described, but it goes without saying that the embodiment to which the present invention can be applied is not limited to the following embodiments.

FIG. 1 is a diagram showing a system configuration example of the conductor simulation training system 1000.
The conductor simulation training system 1000 simulates the conductor work related to the arrival and departure of a virtual train at a station, including opening and closing of a train door based on the operation of an open / close operation button in virtual reality space, and getting on and off passengers, based on a given scenario. It is a training system using the VR image (virtual reality space image).

The commander simulation training system 1000 includes a headset 1002, VR (Virtual Reality) goggles 1010, an external tracking sensor 1020, a simulated crew room set 1030, a commander simulated operation unit 1040, and a computer 1100.

The headset 1002, the VR goggles 1010, the external tracking sensor 1020, and the driver's simulated operation unit 1040 are connected to the computer 1100 via a wired or wireless network N so as to be capable of data communication.

The headset 1002 is one of the tools worn by the trainee user. The headset 1002 includes a microphone 1003 and a headphone 1004.

The VR goggles 1010 is one of the tools worn by the user, and is a head-mounted display that displays a VR image from the user's first-person viewpoint simulated by the computer 1100.

The VR goggles 1010 include an eye tracking device 1012 for tracking the line-of-sight direction of the user, and an acceleration sensor 1014 and a gyro sensor 1016 for tracking the position and posture of the user's head. The VR goggles 1010 sequentially transmit measurement data from these devices and sensors to the computer 1100 via the network N.

The external tracking sensor 1020 is a group of sensors that sense the user from the outside, and tracks the relative position and the relative posture of the VR goggles 1010 with respect to the simulated crew room set 1030. The type of sensor can be appropriately set depending on the tracking method to be adopted, but can be realized by, for example, an image sensor, a distance sensor, or the like. The accelerometer 1014, the gyro sensor 1016, and the external tracking sensor 1020 track the position of the user or VR goggles 1010. The external tracking sensor 1020 can be omitted if the sensor built in the VR goggles 1010 can sufficiently realize the tracking function.

The simulated crew room set 1030 is a training set that reproduces the crew room in the vehicle that the user is on board after training, and the area around the doorway thereof. The user can enter and exit from the simulated doorway of the simulated crew room set 1030. The simulated crew room set 1030 is provided with a simulated operation unit 1040 for the conductor.

The conductor simulated operation unit 1040 is an operation input device installed in an actual crew room and imitating an operation unit operated by the conductor. The conductor simulated operation unit 1040 includes, for example, an open / close operation button 1042 for opening and closing a train door, a signal button for emitting a signal to convey a given intention to the driver, a transmission / reception device for talking with the driver, and the like. .. What the conductor simulated operation unit 1040 is equipped with is set according to the specifications of the actual vehicle.

The computer 1100 is a control device that integrally controls the conductor simulation training system 1000. The computer 1100 includes, for example, a device main body 1101, a keyboard 1106, a touch panel 1108, and a control board 1150.

The control board 1150 is equipped with various microprocessors such as CPU (Central Processing Unit) 1151, GPU (Graphics Processing Unit) and DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM and ROM, and communication device 1153. ing. A part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a SoC (System on a Chip).

Then, the computer 1100 integrally controls the conductor simulation training system 1000 by the control board 1150 performing arithmetic processing based on a predetermined program and data.

FIG. 2 is a diagram showing an example of setting a training ground of a conductor simulation training system.
A simulated crew room set 1030 is installed in the training ground, and external tracking sensors 1020 are arranged in an appropriate number and at appropriate locations so as to include the inside and outside of the simulated crew room set 1030 in the measurement area. User 3 wears the headset 1002 and VR goggles 1010, and trains the conductor work in various situations from the timing when the train approaches the platform of the station where the train is scheduled to stop to the time when the train departs and leaves the station. I do.

FIG. 3 is a diagram showing an example of a virtual reality space controlled by a computer 1100.
The computer 1100 prepares a three-dimensional virtual reality space, and arranges various objects for training the conductor work related to the arrival and departure of virtual trains at stations, including opening and closing train doors and getting on and off passengers, as virtual reality. And control them.

Specifically, the computer 1100 arranges and controls a train object 20, a home-related object 30, a passenger object 40, an ITV object 42, and a background object (not shown), which are a collection of vehicle-related objects. do.

The train object 20 reproduces the actual train that the user 3 will be on board in the future. As for the object of the vehicle which is regarded as a passenger car among the train objects 20, a car side light object 22 is prepared above each train door. The vehicle side light object 22 is controlled to be turned on and off in the virtual reality space by simulation of the computer 1100.

The home-related object 30 includes various objects for reproducing the periphery of the platform of the station, such as the floor surface, pillars, ceiling, eaves, various lamps, and railroad tracks of the platform. In particular, the home-related object 30 includes a Braille block object 32, a home outer edge object 34, and a home inner object 36.

Then, a single or a plurality of passenger objects 40 are arranged and controlled on the home floor of the home-related object 30. The appearance and shape of the passenger represented by the passenger object 40, the arrangement position and number of the passenger object 40, the operation while waiting for the train of the passenger object 40, the timing when the passenger object 40 gets into the vehicle, the passenger object 40 gets into the vehicle. The operation, etc. can be set as appropriate according to the expected situation.

As a variation of the passenger object 40, for example, a rushing passenger, a mother and child trying to get in by pushing a baby carriage, a tourist with a large baggage, an elderly person with a cane, an elementary school student who acts as a group, and the like can be appropriately set. Men and women of all ages and physique can be set in various ways. Then, the operation of each passenger object 40 according to the shape of the passenger is individually controlled by the computer 1100.

Further, the ITV object 42 is set somewhere in the home formed by the home-related object 30. In the example of FIG. 3, the ITV object 42 imitates a type of ITV device supported by a support from the floor surface of the home, but may imitate a ceiling-suspended type ITV device.

A viewpoint camera (virtual camera) corresponding to the viewpoint of the user 3 is also arranged in the virtual reality space. In FIG. 3, the figure of the user 3 and the VR goggles 1010 and the like are shown for easy understanding, but it is assumed that the viewpoint cameras are arranged at the positions of the left and right eyes of the user 3. The position and orientation of these viewpoint cameras are controlled by the computer 1100 in conjunction with the tracking related to the VR goggles 1010. Incidentally, in FIG. 3, the rectangle drawn by the broken line is the shooting range by the viewpoint camera. In other words, the rectangle drawn by the broken line is the range of the VR image of the user's field of view displayed by the VR goggles 1010. Only the VR image of the user's field of view is visible to the user 3, and the VR image (user's field of view) changes according to the change in the posture (orientation) and the position of the VR goggles 1010.

FIG. 4 is a diagram for explaining a record of the behavior of the user 3 in the conductor simulation training system 1000.
The eye tracking device 1012 built in the VR goggles 1010 continuously performs the measurement necessary for obtaining the line-of-sight direction of the user 3. Then, the VR goggles 1010 transmit the measurement data to the computer 1100. Further, the acceleration sensor 1014 and the gyro sensor 1016 built in the VR goggles 1010 also continuously measure, and the VR goggles 1010 transmits the measurement data to the computer 1100. The external tracking sensor 1020 also continuously performs measurement and transmits the measurement data to the computer 1100.

The computer 1100 tracks the relative position and posture of the VR goggles 1010 with respect to the simulated crew room set 1030 from the measurement data of the external tracking sensor 1020, and uses the measurement data of the acceleration sensor 1014 and the gyro sensor 1016 to track the VR goggles 1010. Improve the accuracy of tracking relative position and relative posture.

Then, the computer 1100 performs primary interlocking control of the position and posture of the viewpoint camera 60 in the virtual reality space based on the relative position and the relative posture of the VR goggles 1010, and the viewpoint camera 60 is performed based on the measurement data of the eye tracking device 1012. Performs secondary interlocking control of the posture of. In the secondary interlocking control, the computer 1100 interlocks the line of sight of the user 3 and the shooting direction of the viewpoint camera 60 with the change in the line of sight of the user 3 in reality based on the result controlled by the primary interlocking control. To control. That is, the position and posture of the head of the user 3 in the virtual reality space are linked and linked in real time with the position and posture of the VR goggles 1010 in the real world, and the shooting direction of the viewpoint camera 60 in the virtual reality space is real. It is linked and linked with the line-of-sight direction of user 3 in the world.

In the commander simulation training system 1000, the user 3 always gazes at each time during the training by utilizing the fact that the shooting direction (depth direction of the camera coordinate system) of the viewpoint camera 60 matches the line-of-sight direction of the user 3. The target (gaze target) is detected from the VR image (ITV object 42 in the example of FIG. 4), and the result is recorded in time series as the gaze target history data 633. FIG. 5 is a diagram showing an example of the recorded content of the gaze target history data 633, and FIG. 6 is an enlarged view of the recorded content of the side surface of the train in the elapsed time zone shown by a broken line in FIG.

In order to record the gaze target history data 633, the computer 1100 traces the shooting direction of the viewpoint camera 60 from the viewpoint camera 60, and selects the first hit object (the object located closest to the line of sight direction). At this time, it is detected as a gaze target that the user 3 is gaze at. Of course, if the sensing resolution of the eye tracking device 1012 is sufficient, the computer 1100 is located at the position closest to the intersection position between the shooting direction of the viewpoint camera 60 for the right eye and the shooting direction of the viewpoint camera 60 for the left eye. The object in may be detected as a gaze target.

More specifically, for the train object 20, the gaze target is detected in units of the train side surface region in which the train side surface on the platform side is divided in the front-rear direction of the train. FIG. 7 is a diagram illustrating detection of a gaze target for the train object 20. In the present embodiment, for example, each area E in which the entire area of the side surface of the train is divided by a predetermined length along the front-rear direction of the train is defined as the side area 1 to 4 of the train, respectively. Then, by detecting the gaze target in the unit of each train side surface area E, it is possible to determine whether or not the entire area of the train side surface is gaze.

Then, as shown in FIG. 5, the computer 1100 classifies the objects to be watched (including at least three of vehicle-related / home-related / ITV), the types of the objects to be watched, and the elapsed time from the start of the simulation. And, are associated with each other, and are accumulated and recorded in the gaze target history data 633. As for the train object 20 among the vehicle-related objects, the elapsed time is recorded for each of the train side areas E of 1 to 4 shown in FIG. 7, as illustrated in an enlarged manner in FIG.

Further, the computer 1100 regards the relative position of the VR goggles 1010 with respect to the simulated crew room set 1030 as the representative position of the user 3 in the real world, and the position of the viewpoint camera 60 controlled in conjunction with the position of the VR goggles 1010 is virtual reality. It is regarded as the position of the user 3 in the space, and the movement history data 634 of the user 3 in the virtual reality space is accumulated and recorded.

Further, the conductor simulated operation unit 1040 outputs an operation input signal corresponding to the type of operation input to the computer 1100. The computer 1100 constantly monitors the operation input to the conductor simulation operation unit 1040 during training, and when the operation input is detected, the elapsed time from the start of the simulation at that time is used as the operation timing for the operation history. Accumulate and record in data 635. The operation history data 635 includes the opening operation timing, which is the timing when the train door is opened, the closing operation timing, which is the timing when the train door is closed, and the safety that informs the driver that the train door is safely closed. At least three types of operation timings, that is, notification operation timings, are recorded.

Further, the computer 1100 records the key timing in the simulated situation as the key timing list 636 separately from the recording of these historical data.
The key timing is the timing on the time axis used to evaluate the conductor behavior. In the present embodiment, the stop timing at which the train stops and the departure timing at which the train departs are recorded as key timings. Of course, timings other than these can be included as appropriate. At the end of the simulation, the computer 1100 compares these key timings with the contents recorded in the various historical data described above to pay attention to what the user 3 should pay attention to at an appropriate timing. Evaluate (whether you are looking at it).

Further, in the present embodiment, the computer 1100 performs an abnormality generation process for generating a given abnormal event simulation as an interrupt process when the abnormality generation condition based on the gaze target is satisfied during the simulation. Then, in this abnormality generation processing, the abnormal event occurrence data 637 related to the generated abnormal event simulation is generated and recorded for each abnormal event simulation.

Here, when closing the train door with the open / close operation button 1042, pay attention to the passengers rushing into the train, and whether passengers or objects are caught in the train door due to the rushing in (vehicle side). It is necessary to check the safety of each train door, such as whether the light is on). On the other hand, depending on the length of the train, it may not be possible to visually recognize the situation near all train doors simply by looking at the side of the train near the entrance / exit of the crew room. In such a case, check the safety by moving on the platform so that the invisible train door can be seen, or by looking at the display of the ITV device.

Therefore, in the abnormality generation processing of the present embodiment, the computer 1100 determines that "the ITV device was not detected as a gaze target at a given ITV gaze timing" as the first abnormality occurrence condition. The ITV gaze timing is set to include at least a predetermined number of seconds immediately before the closing operation is performed by the opening / closing operation button 1042. For example, the period from 2 seconds before the closing operation to 3 seconds after the closing operation is defined as the ITV gaze timing.

Specifically, the computer 1100 refers to the gaze target history data 633 when the period of the ITV gaze timing has elapsed, and determines whether or not the ITV device is set as the gaze target of the period. Then, it is determined that the first abnormality occurrence condition is affirmed, assuming that it is not detected if it is not set.

Further, in the present embodiment, it is determined as the second abnormality occurrence condition that "at a given train side gaze timing, the train side area continuous in the front-rear direction of the train was not continuously detected as a gaze target". The train side gaze timing is set as the period from when the train stops at the station to when it departs. For example, the period from 2 seconds before the closing operation of the opening / closing operation button 1042 to 3 seconds after the closing operation is defined as the train side gaze timing.

Specifically, the computer 1100 refers to the gaze target history data 633 when the period of the train side gaze timing has elapsed, and reads out the gaze target of the period. Then, it is determined whether or not the continuous train side area E is continuously gazed during the period. For example, in the present embodiment, when all the train side surface regions E are set as gaze targets in order from the right end to the left end toward FIG. 7, or when they are set as gaze targets in order from the left end to the right end. , The second abnormality occurrence condition is negatively determined. FIG. 6 shows an example of the latter. If none of the cases apply, the second abnormality occurrence condition is determined affirmatively. That is, if the user 3 visually recognizes the entire side surface of the train while shifting the line of sight from one end side to the other end side of the train, it is determined that the second abnormality occurrence condition is not satisfied. It should be noted that the second abnormality occurrence condition may be set by focusing on the side surface of the train in a predetermined range from the rear of the train instead of the entire side surface of the train. Depending on the shape of the station platform to be simulated and the congestion situation on the platform, it may not be possible to see to the beginning of the train. It depends on the fact that it can be judged by complementing whether or not the safety of the entire side of the train has been confirmed.

Then, the computer 1100 generates an abnormal event simulation as an interrupt process when the first abnormality occurrence condition is satisfied and the second abnormality occurrence condition is also satisfied. For example, a simulation of the occurrence of passengers rushing into a train (hereinafter referred to as "rush simulation") or a simulation of the occurrence of passengers or objects being pinched at a train door (hereinafter referred to as "pinching simulation") is generated. Which one to generate is, for example, randomly selected and determined.

After that, the abnormal event occurrence data 637 related to the generated abnormal event simulation is generated and recorded for each abnormal event simulation. Specifically, one abnormal event occurrence data 637 includes the elapsed time (which can be said to be the simulation time) at the time when the abnormal event simulation is generated, the type of the abnormal event simulation (rush simulation or sandwiching simulation), and the said. The contents of the user 3's response to the occurrence of the abnormal event related to the abnormal event simulation are recorded. Basically, when a passenger rushes in or a passenger or an object is caught in the train door, the train door is opened. Therefore, the content of the countermeasure includes information on whether or not the train door has been opened by the open / close operation button 1042 when the abnormal event occurs.

It should be noted that the abnormality event simulation may be generated not only when both the first abnormality occurrence condition and the second abnormality occurrence condition are satisfied, but also when either one is satisfied. Further, only the first abnormality occurrence condition may be determined to generate the abnormal event simulation, or only the second abnormality occurrence condition may be determined to generate the abnormal event simulation.

Further, the second abnormality occurrence condition is not limited to the above-mentioned condition content, and may be "the train side surface was not detected as a gaze target at the train side gaze timing" or the like. Then, for example, when all the train side surface regions E are not set as the gaze targets during the train side gaze timing period, the second abnormality occurrence condition may be determined affirmatively. That is, even if the train is not continuously viewed from one end side to the other end side, it may be determined that the second abnormality occurrence condition is not satisfied as long as the line of sight is directed to the entire area.

Further, both the rush simulation and the pinch simulation may be generated as the abnormal event simulation, or it may be randomly determined whether to generate both or one of them.

8 to 11 are diagrams showing an example of presentation after simulation.
After the simulation is completed, the computer 1100 makes some presentations based on the record of the action of the user 3. The presentation (display) will be described as being performed by the VR goggles 1010, but may be performed by the touch panel 1108.

For example, as shown in FIG. 8, the gaze target history display 70 is performed as the first presentation. Specifically, the computer 1100 arranges an object of the gaze target history display 70 at a predetermined position in front of the field of view of the user 3 in the virtual reality space. In the gaze target history display 70, the horizontal axis is the elapsed time from the start of the simulation, and the timing of the gaze target is shown for each gaze target. Further, in the gaze target history display 70, the operation timing (open operation timing T2, closing operation timing T3, safety notification operation timing T4, etc.) and key timing (stop timing T1, departure timing T5, etc.) are set in the elapsed time on the horizontal axis. Is displayed. In addition, when an abnormal event occurs during the simulation, the occurrence timing T10 is also displayed. FIG. 8 shows an example in which the train door is not opened after the occurrence of the abnormal event simulation, and the abnormal event is not appropriately dealt with.

By presenting the gaze target history display 70, the user 3 opens the train door from the time the train enters the platform to the time the train stops, the time the train stops until the train door is opened, and the time the train door is opened to closed. You can know when and what you were paying attention to in each situation, using the timing of the five situation changes after the train departed as a guide until the train closes and the safety notice ends and the train departs. Furthermore, when an abnormal event simulation occurs, what was the user 3 paying attention to (at the ITV gaze timing or the train side gaze timing) when the ITV device or the side of the train should be gazed immediately before that? Can be known.

Further, the computer 1100 presents the gaze target history display 70 and also presents the model gaze history display 72 in which the gaze target history data 633 obtained by performing the same simulation by another user acting as a teacher is regarded as the teacher data. Specifically, the computer 1100 arranges the object of the model gaze history display 72 at a predetermined position in front of the field of view of the user 3 in the virtual reality space (for example, a position alongside the object of the gaze target history display 70).

By comparing the gaze target history display 70 and the model gaze history display 72, the user 3 can know at what timing he / she did not see what he / she should gaze at, how often he / she gazed at the target to be watched, and the like. Can be done. By utilizing the knowledge in the next training, the user 3 can obtain a high training effect.

Further, with the presentation of the gaze target history display 70, as shown in FIG. 9, for example, the evaluation result of whether or not the computer 1100 has gazed at the gaze target (specific gaze target) required as a particular gaze target. 74 is presented as a second presentation. The evaluation result 74 indicates whether the user 3 was able to gaze at a specific gaze target at an appropriate timing. The computer 1100 arranges an object for displaying the evaluation result 74 at a predetermined position in front of the user 3's field of view in the virtual reality space. FIG. 9 shows an example in which “◯” is shown when the person can gaze, and “×” is shown when the person cannot gaze, but the method of expressing the evaluation is not limited to this.

The appropriate timing for paying attention to the "specific gaze target" referred to here can be appropriately set. For example, within a predetermined time immediately after the timing when the lighting of the vehicle side light object 22 changes according to the operation input to the open / close operation button 1042 (see FIG. 2) of the conductor simulated operation unit 1040 (for example, a predetermined time from the closing operation timing T3). The car side light object 22 in (inside) corresponds to this. If the user 3 is gazing at the car side light object 22 within the predetermined time, the computer 1100 considers that after closing the train door, it confirms that all the car side lights are turned off, and the car It is evaluated that the gaze of the side light object 22 was performed (more accurately, it was performed at an appropriate timing).

Further, for example, the platform outer edge object 34 (see FIG. 2) during the period from departure to the time when the train leaves the station (departure timing T5 or later in terms of elapsed time) also corresponds to a specific gaze target. The computer 1100 remains in the train and the platform that started running if the user 3 is watching the outer edge of the platform for a predetermined ratio or more until the train departs and leaves the station (for example, a predetermined time). It was considered that he was checking whether there was any contact with the passengers and whether there was anything caught in the gap between the train and the platform, and he was paying close attention to the object 34 at the outer edge of the platform (more accurately, appropriate). It was done at the right timing).

Further, for example, the home-related object 30 (particularly, the railroad track object) in the elapsed time zone corresponding to the process in which the train leaving the station after the departure timing T5 also corresponds to this. If the user 3 is gazing at the home-related object 30, especially the railroad track object, in the elapsed time, the computer 1100 considers that the user 3 has confirmed the rear railroad track after the train has left the station. It is evaluated that the rear line was confirmed at an appropriate timing.

Further, when the computer 1100 generates an abnormal event simulation during the simulation, for example, as shown in FIG. 10, the computer 1100 handles an abnormality as to whether or not the user 3 has appropriately dealt with the occurrence of the abnormal event simulation. The evaluation result 76 (76-1 or 76-2) is presented as a third presentation. Specifically, when the rush simulation is generated, the abnormality coping evaluation result 76-1 as to whether or not the rushing ride of the passenger is appropriately dealt with is presented. If the pinch simulation is generated, the abnormality coping evaluation result 76-1 as to whether or not the pinching of a passenger or an object at the train door is appropriately dealt with is presented. For example, based on the abnormal event occurrence data 637, if the user 3 opens the train door with the open / close operation button 1042 at the time of the occurrence of the abnormal event, it is presented as "○", otherwise it is presented as "×" or the like. can do.

Further, for example, as shown in FIG. 11, the computer 1100 classifies the gaze target into at least three of vehicle-related / home-related / ITV, and presents the time ratio of each of the gaze targets. 78 is presented as a fourth presentation. Although the number of classifications is four in FIG. 11, it may be five or more.

Then, the computer 1100 compares and displays the model classification ratio 79 based on the gaze target history data 633 obtained by performing the same simulation by another user acting as a teacher. Therefore, a high training effect can be obtained as in the case of the comparative presentation related to the gaze history described above.

FIG. 12 is a functional block diagram showing a functional configuration example of the conductor simulation training system 1000.
The conductor simulation training system 1000 includes a management operation input unit 100, a conductor operation input unit 102, a conductor voice input unit 103, a line-of-sight tracking measurement unit 104, a position tracking measurement unit 106, a calculation unit 200, and a VR image display. It has a unit 320, a sound output unit 390, a management image display unit 392, and a storage unit 500.

The management operation input unit 100 is an operation input for system management of the vehicle operator simulation training system 1000 (for example, a selection operation input of a scenario to be simulated, a selection operation input of whether the user performing the simulation is a teacher or a trainer, Etc.) and output the operation input signal to the calculation unit 200. In the example of FIG. 1, the keyboard 1106 and the touch panel 1108 correspond to this.

The conductor operation input unit 102 receives various operation inputs performed by the user 3 during the simulation as the conductor, and outputs an operation input signal to the calculation unit 200. In the example of FIG. 1, the conductor simulated operation unit 1040 provided with the open / close operation button 1042 and the like corresponds to this.

The conductor voice input unit 103 outputs the voice signal of the voice emitted by the user 3 during the simulation as the conductor as the conductor to the calculation unit 200. In the example of FIG. 1, the microphone 1003 of the headset 1002 corresponds to this.

The line-of-sight tracking measurement unit 104 performs measurement for tracking the line of sight of the user 3 and outputs the measurement data to the calculation unit 200. In the example of FIG. 1, the eye tracking device 1012 incorporated in the VR goggles 1010 corresponds to this. The front direction of the VR goggles 1010 may be regarded as the line-of-sight direction of the user 3. In that case, the acceleration sensor 1014, the gyro sensor 1016, and the external tracking sensor 1020 built in the VR goggles 1010 correspond to this. Become.

The position tracking measurement unit 106 measures the position of the user 3 in the real world and outputs the measurement data to the calculation unit 200. In the example of FIG. 1, the acceleration sensor 1014, the gyro sensor 1016, and the external tracking sensor 1020 built in the VR goggles 1010 correspond to this.

The arithmetic unit 200 is realized by, for example, a microprocessor such as a CPU or GPU, or an electronic component such as an IC memory, and controls data input / output between various operation input units, various measurement units, and a storage unit 500. conduct. Then, predetermined programs and data, operation input signals from the management operation input unit 100 and the commander operation input unit 102, voice signal input from the commander voice input unit 103, measurement from the line-of-sight tracking measurement unit 104 and the position tracking measurement unit 106. The operation of the driver simulation training system 1000 is controlled by executing various arithmetic processes based on the data and the like. In the example of FIG. 1, the control board 1150 of the computer 1100 corresponds to this.

The calculation unit 200 in the present embodiment includes a line-of-sight tracking control unit 204, a position tracking control unit 206, a simulation unit 210, a VR image generation unit 220, a presentation control unit 222, a gaze target detection unit 230, and the like. It includes an abnormality generation processing unit 232, a recording control unit 234, a timing unit 280, a sound generation unit 290, and a management image generation unit 292.

The line-of-sight tracking control unit 204 performs arithmetic processing for line-of-sight tracking based on the measurement data by the line-of-sight tracking measurement unit 104, and obtains a tracking line-of-sight (for example, a line-of-sight direction vector) in a virtual reality space. That is, the line-of-sight tracking measurement unit 104 and the line-of-sight tracking control unit 204 configure the line-of-sight tracking unit 304 that tracks the line of sight of the user 3 based on the eye tracking device incorporated in the VR goggles 1010. The line-of-sight tracking unit 304 can also be configured without using an eye tracking device. For example, the line-of-sight tracking unit 304 may realize line-of-sight tracking by regarding the front direction of the VR goggles 1010 (that is, the front direction of the head) as the line-of-sight direction and estimating the line-of-sight direction from position tracking and posture tracking.

The position tracking control unit 206 performs arithmetic processing for position tracking based on the measurement data by the position tracking measurement unit 106, and obtains the position coordinates (tracking position) of the user 3 in the virtual reality space. That is, the position tracking measurement unit 106 and the position tracking control unit 206 form a position tracking unit 306 that tracks the position of the user 3 (or VR goggles 1010).

The simulation unit 210 simulates the conductor work related to the arrival and departure of a virtual train at a station, including the opening and closing of train doors and the boarding and alighting of passengers based on the operation of the open / close operation button 1042 in the virtual reality space, based on a given scenario. , Control various objects placed in virtual reality space. Specifically, the simulation unit 210 simulates from the timing when the train approaches the platform of the station where the train is scheduled to stop until the train departs and leaves the station. Along with this, the simulation unit 210 also simulates the content displayed by the ITV device installed in the home in the virtual reality space.

The VR image generation unit 220 generates a VR image to be displayed on the VR goggles 1010 being simulated based on the tracking line of sight by the line-of-sight tracking unit 304 and the tracking position by the position tracking unit 306, and displays the display control signal in the VR image display unit 320. Output to.

The VR image display unit 320 is an image display device for displaying a VR image. In the example of FIG. 1, VR goggles 1010 corresponds to this.

After the simulation, the presentation control unit 222 performs display control for presenting the time-series change of the gaze target and the operation timing of the open / close operation button 1042 to the user 3 who is the trainee. The presentation control unit 222 has an evaluation unit 223 that "evaluates" the training result.

In the present embodiment, since the presentation is performed by the VR goggles 1010, the presentation control unit 222 presents the presentation (gaze target history display 70, model gaze history display 72, evaluation result 74) at a predetermined position in front of the tracking line of sight in the virtual space. When the object according to the abnormality coping evaluation result 76, the gaze classification ratio 78, and the model classification ratio 79) is arranged, the VR image generation unit 220 inevitably generates a VR image including the object related to the presentation.

The gaze target detection unit 230 detects the gaze target in the virtual reality space of the user 3 based on the tracking line of sight and the VR image. Specifically, the computer 1100 detects an object in which the tracking line of sight (line of sight vector) from the viewpoint camera 60 first intersects among the objects arranged in the virtual reality space as a gaze target. Further, the gaze target detection unit 230 classifies the gaze target into at least three of vehicle-related / home-related / ITV, and records the classification result. It should be noted that an object in which the tracking line of sight from the viewpoint camera 60 continuously intersects for a predetermined time (for example, 0.5 seconds or 1.0 second) or longer (the line of sight is stationary) may be detected as a gaze target. ..

The abnormality generation processing unit 232 is a functional unit that performs abnormality generation processing, and generates a given abnormal event simulation as interrupt processing during simulation when the abnormality generation condition based on the gaze target is satisfied.

The record control unit 234 records and manages the action history of the user 3 during the simulation and various data necessary for evaluating the action history. Specifically, the recording control unit 234 controls recording and management of gaze target history data 633, movement history data 634, operation history data 635, key timing list 636, abnormal event occurrence data 637, and the like (see FIG. 4). ).

The timekeeping unit 280 uses the system clock to measure the simulation time, the time limit, the elapsed time from the start of the simulation, and the like.

The sound generation unit 290 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec capable of reproducing a voice file, and generates simulated environmental sounds and sound signals of various operation sounds. , Is output to the sound output unit 390.

The sound output unit 390 is realized by a device that outputs (sounds) sound based on a sound signal input from the sound generation unit 290. In the example of FIG. 1, the headphone 1004 of the headset 1002 corresponds to this.

The management image generation unit 292 controls the generation of various image data related to the management of the conductor simulation training system 1000 and the generation and output of image signals for displaying those images on the management image display unit 392.

The management image display unit 392 displays various images related to the management of the conductor simulation training system 1000 based on the image signal input from the management image generation unit 292. For example, it can be realized by an image display device such as a flat panel display, a projector, or a head-mounted display. In this embodiment, the touch panel 1108 of FIG. 1 corresponds to this.

The storage unit 500 stores a program for realizing various functions for making the calculation unit 200 control the conductor simulation training system 1000 in an integrated manner, various data, and the like. Further, it is used as a work area of the calculation unit 200, and temporarily stores the calculation result executed by the calculation unit 200 according to various programs, various data input to the calculation unit 200, and the like. Such a function is realized by, for example, an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, or the like. In the example of FIG. 1, the IC memory 1152 mounted on the control board 1150 corresponds to this. It is also possible to configure using online storage.

FIG. 13 is a diagram showing an example of a program and data stored in the storage unit 500. The storage unit 500 stores the simulation program 503, the scenario data 510, the simulation control data 600, the user action history data 630, the teacher data 700, and the current date and time 800 for managing the training date and time. do. Of course, programs and data other than these can be stored as appropriate.

The simulation program 503 realizes various functions (line-of-sight tracking control unit 204 to management image generation unit 292; see FIG. 12) for the arithmetic unit 200 to integrally control the conductor simulation training system 1000.

The scenario data 510 is prepared for each content of the simulated situation, and stores various initial setting data for realizing the situation in the virtual reality space. For example, data of various scenarios with different arrival / departure stations (including the type of platform), arrival line, type of train to be on board, time zone, weather, number of passengers, etc. are prepared. One scenario data 510 includes, for example, a unique scenario ID 511, environment setting data 513, and object-specific automatic control setting data 515. Of course, data other than these can be included as appropriate.

The simulation control data 600 stores various control data related to simulation execution. For example, the simulation control data 600 includes a usage scenario ID 601, a user setting 603 indicating whether the user performing the simulation is a teacher or a trainer, an elapsed time 607 from the start of the simulation indicating the simulation time, and tracking data. 609 and object control data 610 for each object are included. Of course, data other than these can be included as appropriate.

The user action history data 630 includes gaze target history data 633, movement history data 634, operation history data 635, key timing list 636, and abnormal event occurrence data 637. Of course, data other than these can be included as appropriate (see FIG. 4).

The teacher data 700 is data in which the user behavior history data 630 when the user acting as the teacher performs the simulation is stored in association with the usage scenario ID 601.

FIG. 14 is a flowchart for explaining the flow of processing in the computer 1100. First, the computer 1100 accepts the selection input of the scenario used for the simulation (step S2).

Further, the computer 1100 accepts the input of the user setting (step SS4). The accepted result is the user setting 603.

Next, the computer 1100 arranges various objects in the three-dimensional virtual space with reference to the scenario data 510 having an ID matching the usage scenario ID 601 which is the ID of the scenario to be used (step S6), and the VR goggles 1010. Tracking is started (step S8).

Next, the computer 1100 starts the simulation (step S10). With the start of the simulation, the computer 1100 starts detecting the object to be watched and starts recording the user action history data 630.

Further, the computer 1100 monitors the satisfaction of the first abnormality occurrence condition and the second abnormality occurrence condition during the simulation, and if both are satisfied (step S12: YES), the abnormality event simulation is used as an interrupt process. Generate (step S14). For example, a run-in simulation or a pinch simulation is randomly selected and generated.

Further, when the simulation is completed (step S16), if the user setting 603 is "teacher" (teacher in step S18), the computer 1100 uses the user behavior history data 630 newly recorded in connection with this simulation. Save as new teacher data 700 (step S20).

On the other hand, if the user setting 603 is "trainee" (trainee in step S18), the computer 1100 starts various presentations (step S22). That is, the computer 1100 has a comparative display (see FIG. 8) of the gaze target history display 70 and the model gaze history display 72, an evaluation result 74 (see FIG. 9), and an abnormality coping evaluation result 76 (see FIG. 10). , A comparative display (see FIG. 11) between the gaze classification ratio 78 and the model classification ratio 79, and display control of each are performed.

Then, when the input of the predetermined end-of-use operation is detected (YES in step S24), the computer 1100 ends a series of processes.

As described above, according to the present embodiment, the abnormal event simulation is not generated based on a predetermined scenario, but interruptively according to the gaze target of the trainee user 3 during the simulation. Anomalous event simulations can be generated. For example, in closing the train door, an abnormal event simulation is generated when the user 3 does not direct his / her line of sight to an object to be watched for safety confirmation. Specifically, the case where the user 3 did not confirm the ITV device or did not confirm by turning the line of sight to the entire side surface of the train was determined as an abnormality occurrence condition, and when the abnormality occurrence condition was satisfied, an abnormal event occurred. Simulations can be generated. In the present embodiment, it is possible to generate a rush simulation that causes a passenger to rush into a train and a rush simulation that causes a passenger or an object to be pinched at a train door. In addition, it is possible to evaluate whether the user 3 has appropriately dealt with the abnormal event related to the generated abnormal event simulation. That is, according to the present embodiment, it is determined from the gaze target of the user 3 whether or not the situation should be suspected of neglecting the safety confirmation necessary for the closing operation of the train door, and it is determined that the situation is the case. It is possible to generate anomalous event simulations and evaluate their countermeasures. Therefore, effective training for learning the safety confirmation that the conductor should perform can be realized.

The embodiment to which the present invention is applicable is not limited to the above, and the components can be changed, added, or deleted as appropriate.

For example, in the setting defined in the scenario data 510, an appropriate range may be provided in the set value so that an appropriate change may occur for each simulation to be executed. For example, for the passenger object 40, a plurality of options are prepared in advance for the appearance timing and the operation pattern, and the computer 1100 randomly selects one of the options (or from the touch panel 1108) at the time of executing the simulation. It may be selected (depending on the selection operation) and applied to the simulation. Since the type, number, and movement of the passenger objects 40 change for each simulation, it is possible to prevent the user 3 who is a trainer from remembering the contents of the simulation and reducing the training effect. The same applies to the setting of environment setting data.

In addition, the configuration for tracking the user's position and line of sight can be changed as appropriate. For example, a marker may be placed on a crew hat worn by the user, and the position of the user may be tracked by detecting the marker by image processing. In addition, the detection of the marker may track the direction of the user's head corresponding to the user's line of sight. As the marker, for example, an AR (Augmented Reality) marker can be used.

FIG. 15 is a schematic view of the training field 1 of the conductor simulation training system in this modified example as viewed from above. As shown in FIG. 15, the conductor simulation training system of this modification further includes a camera 1050 as an image pickup unit and a marker 91 arranged at a predetermined position of a crew cap (railroad cap) 9.

The cameras 1050 are arranged in an appropriate number and at appropriate locations so that the inside and outside of the simulated crew room set 1030 are included in the photographing area. In FIG. 15, five cameras 1050 are arranged.

The markers 91 are arranged at three positions, for example, in front of the crew cap 9 (position of the cap badge) and on both the left and right sides (position of the left and right ear badges). The marker 91 adopts any design as long as the marker 51 can be identified based on the captured image of the camera 1050 and the distance from the camera 1050 and the relative orientation (relative posture) can be detected. You may. For example, it is possible to adopt a design of a predetermined size having a feature of displaying the reference direction on the surface and identifying the marker 91. It may be a two-dimensional code or the like.

Then, the computer 1100 tracks the position of the user wearing the crew hat 9 by calculating the position / orientation (posture) of each marker 91 from the images taken by each camera 1050, and corresponds to the line of sight of the user. Track the orientation of your head.

That is, in this modification, the camera 1050 and the marker 91 correspond to the position tracking measurement unit 106, and the captured image of each camera 1050 is output to the calculation unit 200 at any time. Then, in the calculation unit 200, the position tracking control unit 206 tracks the position of the user by calculating the position / orientation (posture) of each marker 91 based on the marker 91 in the captured image of each camera 1050. Specifically, the position tracking control unit 206 analyzes the captured image of the camera 1050 to detect and identify the marker 91. Then, from the comparison between the size in the captured image of the identified marker 91 and the actual size (specified size), and the orientation in the captured image of the identified marker 91 and the shooting orientation of the camera 1050, each in the training field 1. By calculating the position / orientation (posture) of the marker 91, the position coordinates (tracking position) of the user are obtained. Since the position and orientation in the training field 1 in the real world are associated with the position and orientation in the virtual reality space, the final tracking position to be obtained is, if necessary, the training field 1 and the virtual reality space. Any of these can be obtained.

Further, in this modification, the camera 1050 and the marker 91 correspond to the line-of-sight tracking measurement unit 104. Then, in the calculation unit 200, the line-of-sight tracking control unit 204 tracks the direction of the user's head as equivalent to the line-of-sight of the user based on the marker 91 in the captured image of each camera 1050. Specifically, the line-of-sight tracking control unit 204 obtains the direction of the marker 91 with respect to the camera 1050 from the reference direction of the marker 91 detected / identified in the captured image of each camera 1050 as described above, and the user's head. Determine the orientation of. Then, the determined direction of the head is regarded as the line-of-sight direction, and the line-of-sight direction (tracking line-of-sight) of the user is estimated. Since the position and orientation in the training field 1 in the real world are associated with the position and orientation in the virtual reality space, the tracking line of sight (line-of-sight direction) finally obtained is the training field 1 as needed. Any of them can be obtained in the virtual reality space.

According to this modification, the marker 91 arranged on the crew hat 9 can be photographed, and the position of the user can be tracked based on the marker 91 in the photographed image. Further, based on the marker 91 in the captured image, it is possible to track the direction of the user's head as equivalent to the line of sight of the user.

Although one marker 91 may be arranged in front of the crew hat 9, a plurality of markers 91 may be arranged and used for position tracking and line-of-sight tracking to improve the tracking accuracy corresponding to the user's position and line-of-sight. It will be possible.

3 ... User 20 ... Train object 22 ... Car side light object E ... Train side area 30 ... Home-related object 32 ... Braille block object 34 ... Home outer edge object 40 ... Passenger object 42 ... ITV object 60 ... Viewpoint camera 70 ... Gaze target History display 72 ... Model gaze history display 74 ... Evaluation result 76 (76-1, 2) ... Abnormal response evaluation result 78 ... Gaze classification ratio 79 ... Model classification ratio 104 ... Line-of-sight tracking measurement unit 106 ... Position tracking measurement unit 200 ... Calculation Unit 204 ... Line-of-sight tracking control unit 206 ... Position tracking control unit 210 ... Simulation unit 220 ... VR image generation unit 222 ... Presentation control unit 230 ... Gaze target detection unit 232 ... Abnormality generation processing unit 234 ... Recording control unit 290 ... Sound generation unit 292 ... Management image generation unit 304 ... Line-of-sight tracking unit 306 ... Position tracking unit 320 ... VR image display unit 500 ... Storage unit 503 ... Simulation program 510 ... Scenario data 600 ... Simulation control data 601 ... Usage scenario ID
607 ... Elapsed time 609 ... Tracking data 610 ... Object control data 630 ... User action history data 633 ... Gaze target history data 634 ... Movement history data 635 ... Operation history data 636 ... Key timing list 637 ... Abnormal event occurrence data 1000 ... Driver simulation Training system 1002 ... Headphones 1010 ... VR goggles 1012 ... Eye tracking device 1020 ... External tracking sensor 1030 ... Simulated crew room set 1040 ... Simulated crew room set 1040 ... Simulated operation unit for commander 1042 ... Open / close operation button 1100 ... Computer

Claims (6)

A simulated cockpit set with train door open / close operation buttons,
VR (Virtual Reality) goggles worn by the user,
The line-of-sight tracking unit that tracks the user's line of sight,
With the control device
Equipped with
The control device is
A simulation unit that simulates the conductor's work related to the arrival and departure of a virtual train at a station, including opening and closing of train doors and getting on and off passengers based on the operation of the open / close operation button in virtual reality space, based on a given scenario.
A VR image generation unit that generates a VR image to be displayed on the VR goggles during the simulation based on the tracking line of sight by the line-of-sight tracking unit.
A gaze target detection unit that detects a gaze target in the virtual reality space of the user based on the tracking line of sight and the VR image, and a gaze target detection unit.
An abnormality generation processing unit that generates a given abnormal event simulation during the simulation when the abnormality generation condition based on the gaze target is satisfied.
Have,
Train conductor simulation training system. The simulation unit simulates the display of an ITV (Industrial TeleVision) device installed in a home in the virtual reality space.
The abnormality generation processing unit determines as the first abnormality generation condition that the ITV is not detected as the gaze target at a given ITV gaze timing.
The conductor simulation training system according to claim 1. The ITV gaze timing includes at least a predetermined number of seconds immediately before the closing operation is performed by the opening / closing operation button.
The conductor simulation training system according to claim 2. A position tracking unit that tracks the position of the user or the VR goggles,
Further equipped,
The simulated crew room set is configured so that it can be entered and exited from the simulated doorway.
The simulation unit simulates from the timing when the train reaches the platform of the station where the train is scheduled to stop until the train departs and leaves the station.
The VR image generation unit generates the VR image based on the tracking line of sight and the tracking position by the position tracking unit.
The abnormality generation processing unit determines as a second abnormality generation condition that the train side surface is not detected as the gaze target at a given train side gaze timing.
The conductor simulation training system according to any one of claims 1 to 3. The gaze target detection unit can detect as a gaze target for each train side area that divides the side of the train in the front-rear direction of the train.
The abnormality generation processing unit determines as the second abnormality generation condition that the train side surface region continuous in the front-rear direction of the train is not continuously detected as the gaze target.
The conductor simulation training system according to claim 4. The abnormal event simulation is a simulation of the occurrence of a passenger rushing into the train and / or the occurrence of a passenger or an object being caught in the train door.
The conductor simulation training system according to any one of claims 1 to 5.

Images