JP7026902B2 - Program and train driving simulator - Google Patents

Description

The present invention relates to a program for displaying a driving screen and executing a train driving simulation.

As a technique related to train operation training, a technique of simulating simulated operation of a train (railroad vehicle) to evaluate a user's confirmation operation (see, for example, Patent Document 1) is known.

Japanese Unexamined Patent Publication No. 2014-71319

According to the technique of Patent Document 1, it is possible to evaluate whether or not the user can correctly turn his / her line of sight to the traffic light or the like set in the simulated railway operating section. However, it was not possible to show the user's line of sight as a whole in the overall operation of the train.

An object of the present invention is to provide a technique capable of presenting a user with a gaze tendency during train operation by driving simulation.

The first invention for solving the above-mentioned problems is
A program for displaying a driving screen and executing a train driving simulation (for example, a simulation program of FIG. 8) on a computer equipped with an eye tracking means (for example, the eye tracker 1202 of FIG. 1) for tracking and detecting a user's line of sight. 501)
During the execution of the driving simulation, the gaze object specifying means for specifying the object in the driving screen to which the user's line of sight is directed at the current driving position as the gaze object at the driving position (for example, the gaze object of FIG. 7). Specific part 216),
After executing the driving simulation, a predetermined statistical process is performed based on the gaze object for each traveling position specified by the gaze object specifying means, and a statistical value related to the time or distance at which the object of a predetermined type is gazed is obtained. Statistical processing means to calculate (for example, statistical processing unit 220 in FIG. 7),
A display control means for displaying and controlling the gaze result based on the statistical value (for example, the gaze result display control unit 222 in FIG. 7).
It is a program for making the computer function.

According to the first invention, the user's gaze object can be specified for each traveling position during the execution of the driving simulation. Then, after the execution of the driving simulation, it is possible to calculate the statistical value related to the time or distance at which the predetermined type of object (object) was gazed and control the display of the gaze result, and when the train is operated by the driving simulation. The gaze tendency can be presented to the user. It is possible to show the user's gaze tendency as a whole in the simulated driving as a whole.

Moreover, the second invention is
The predetermined type of object includes at least an object related to a railway signal and an object related to a railroad track.
This is the program of the first invention.

According to the second invention, the object related to the railway signal and the object related to the railroad track can be specified as a gaze object. Therefore, it is possible to present to the user the tendency to gaze at the railway signal and the tendency to gaze at the railroad track in the entire simulated operation.

Moreover, the third invention is
The objects related to the railroad track are the object related to the vicinity of the railroad track where the distance from the current running position is located on the short distance side based on the predetermined distance threshold, and the distance from the current running position based on the distance threshold is the long distance side. There is an object related to the front of the track located in
When the object to which the user's line of sight is directed is an object related to the railroad track, the gaze object specifying means further specifies whether the object is related to the vicinity of the railroad track or the object related to the front of the railroad track. To identify,
This is the program of the second invention.

According to the third invention, when the user's line of sight is directed to the object related to the railroad track, whether the gaze object is an object related to the vicinity of the railroad track on the short-distance side from the current traveling position or the railroad track on the long-distance side. It is possible to further specify whether the object is related to the front. Therefore, it is possible to present to the user the tendency to gaze at the vicinity of the railroad track on the short-distance side and the tendency to gaze at the front of the railroad track on the long-distance side.

Moreover, the fourth invention is
The distance threshold is set stepwise for each train speed range.
When the object to which the user's line of sight is directed is an object related to the railroad track, the gaze object specifying means uses a distance threshold according to the current traveling speed to use the object related to the vicinity of the railroad track or the front of the railroad track. The gaze object is specified by further specifying whether it is an object related to the above.
This is the program of the third invention.

According to the fourth invention, the distance threshold used for specifying whether the object is related to the vicinity of the railroad track or the object related to the front of the railroad track can be set according to the current traveling speed of the train, and is the user looking near the railroad track? Whether you were looking in front of the track can be properly determined according to the traveling speed.

Moreover, the fifth invention is
The predetermined type of object includes an object related to a traffic light.
When the gaze object specified by the gaze object specifying means is an object related to the traffic light, the gaze distance from the traveling position when the user's line of sight is directed to the gaze object is determined. Calculated traffic light gaze distance calculation means (for example, traffic light gaze distance calculation unit 218 in FIG. 7),
Further prepare
The statistical processing means calculates a statistical value related to the gaze distance that was gaze at the object related to the traffic light.
It is a program of any one of the first to fourth inventions.

According to the fifth invention, the object related to the traffic light can be specified as a gaze object. Then, a statistical value can be calculated for the gaze distance from the traveling position to the gaze object when the user's gaze is directed at the object related to the traffic light, which is the gaze object, and can be presented to the user as the gaze result.

Moreover, the sixth invention is
The statistical processing means calculates the statistical value in the target section set as all or a part of the driving section by the driving simulation.
It is a program of any one of the first to fifth inventions.

Moreover, the seventh invention is
The target section is any one or more sections of a section at the time of departure from a station, a section at coasting operation, a section at the time of arrival at a station, and a section at the time of passing a railroad crossing.
This is the program of the sixth invention.

According to the sixth invention, statistical values can be calculated for a target section which is all or a part of the driving section, and the gaze result can be presented to the user. Then, according to the seventh invention, any one section or a plurality of sections of the section at the time of departure from the station, the section of coasting operation, the section at the time of arrival at the station, and the section at the time of passing the railroad crossing are set as the target section. can do.

Moreover, the eighth invention is
The computer comprises a console and / or instrument rack for the driving simulation.
The statistical processing means further calculates a statistical value relating to the time or distance when the user's line of sight is out of the driving screen while the driving simulation is being executed.
It is a program of any one of the first to seventh inventions.

According to the eighth invention, a statistical value relating to the time or distance at which the user's line of sight was directed outside the operation screen where the operation console or instrument rack for driving simulation is installed is calculated, and the gaze result is obtained by the user. Can be presented to.

Moreover, the ninth invention is
The display control means further displays and controls the model gaze result based on the statistical value when the model user performs the driving simulation.
It is a program of any one of the first to eighth inventions.

According to the ninth invention, for example, it is possible to display a user's gaze result in comparison with a model gaze result when a model user who is an expert such as an instructor performs a driving simulation.

Moreover, the tenth invention is a tenth invention.
A train driving simulator (for example, the train driving simulator 1000 in FIG. 1) that displays a driving screen and executes a train driving simulation.
A line-of-sight detection means for tracking and detecting a user's line of sight during execution of the driving simulation,
During the execution of the driving simulation, the gaze object specifying means for specifying the object in the driving screen to which the user's line of sight is directed at the current driving position as the gaze object at the driving position,
After executing the driving simulation, a predetermined statistical process is performed based on the gaze object for each traveling position specified by the gaze object specifying means, and a statistical value related to the time or distance at which the object of a predetermined type is gazed is obtained. Statistical processing means to calculate and
A display control means for displaying and controlling the gaze result based on the statistical value,
It is a train driving simulator equipped with.

According to the tenth invention, it is possible to realize a train operation simulator having the same effect as that of the first invention.

The figure which shows the whole composition example of a train operation simulator. The figure which shows an example of the operation screen. The figure explaining the gaze object identification process. The figure which shows the setting example of the distance threshold value. The figure which shows the display example of the gaze result. The figure which shows the other display example of the gaze result. A block diagram showing a functional configuration example of a train operation simulator. The figure which shows the example of the program and data which a storage part stores. The figure which shows the data composition example of the object position definition data by simulation environment. The figure which shows the data composition example of the gaze object identification result data. The figure which shows the data composition example of the simulation control data. A flowchart for explaining the flow of processing in a computer. A flowchart for explaining the flow of the gaze object identification process. A flowchart for explaining the flow of statistical processing.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. It should be noted that the embodiments described below do not limit the present invention, and the embodiments to which the present invention can be applied are not limited to the following embodiments. Further, in the description of the drawings, the same parts are designated by the same reference numerals.

[Overall configuration example]
FIG. 1 is a diagram showing an overall configuration example of the train operation simulator 1000 according to the present embodiment. The train operation simulator 1000 of the present embodiment is a device for training train operation, and includes a computer 1100, an eye tracker 1202, a video monitor 1204, and an instrument rack 1208, which are communicably connected by a communication line 9. It is a computer system including an operation console 1206 and the like. In the example of FIG. 1, since a train operation simulator 1000 for one person is assumed, only one set of the eye tracker 1202, the video monitor 1204, and the operation console 1206 is shown, but it is possible for a plurality of people to train at the same time. In the case of, a plurality of such sets shall be provided. Although not shown, a timetable (a timetable carried by the driver that describes the arrival time and departure time of each station), a driver's notebook, and the like are arranged near the operation console 1206. That is, in the use of the training user, the form is a mode simulating a driver's cab or a crew room.

The communication line 9 means a communication path capable of data communication. That is, the communication line 9 includes a telephone communication network, a cable network, a communication network such as the Internet, as well as a LAN (Local Area Network) using a dedicated line (dedicated cable) for direct connection and Ethernet (registered trademark). It is meaningful, and the communication method may be wired or wireless.

The computer 1100 has a main body device 1101, a keyboard 1106, and a touch panel 1108, and a control board 1150 is mounted on the main body device 1101.

The control board 1150 is equipped with various microprocessors such as CPU (Central Processing Unit) 1151, GPU (Graphics Processing Unit) and DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM and ROM, and communication device 1153. Has been done. A part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (field-programmable gate array), or a SoC (System on a Chip).

Then, the computer 1100 controls the train operation simulator 1000 in an integrated manner by performing arithmetic processing on the control board 1150 based on a predetermined program and data.

Although the computer 1100 is described as a single unit, it may be configured such that a plurality of computers sharing each function are mounted and connected to each other via an internal bus so that data communication is possible. Alternatively, a plurality of independent computers installed at remote locations may be configured to function as the computer 1100 as a whole by performing data communication via the communication line 9.

As for the set of the eye tracker 1202, the video monitor 1204, and the operation console 1206, one training user uses one set.

The eye tracker 1202 has a first function of detecting, tracking, and analyzing the movement of the user's line of sight in a predetermined tracking cycle, and a second function of detecting, tracking, and analyzing the orientation of the user's head. It is possible to transmit data for detecting the movement of the line of sight and the head, or data of the calculation result obtained by tracking and analyzing the movement of the line of sight and the head to the computer 1100.

The eye tracker 1202 may be realized as a non-wearable stationary device installed in front of the user as shown in FIG. 1, or as a wearable device worn by the user in the form of glasses or goggles. May be good. Further, the method of detecting the movement of the line of sight is not particularly limited. For example, the user may be photographed from the front with an image pickup sensor, the captured image may be image-processed to detect a portion where the pupil is reflected, the direction of the detected pupil may be determined, and the line-of-sight direction may be calculated. Any method may be adopted, such as a method of detecting the orientation of the user's head or a method of detecting the captured image by image processing. When the eye tracker 1202 is a wearable device, a method of incorporating an acceleration sensor or a gyro sensor and detecting the orientation of the head based on the detection values of these sensors can also be adopted. Further, in the eye tracker 1202, a sensor portion such as an image pickup sensor and a device for performing arithmetic processing may be integrated, or the latter may be realized by a computer 1100.

The video monitor 1204 is a display device for displaying a driving screen which is a virtual landscape image seen from the driver's seat in the driving simulation, and can display an image according to a signal output from the computer 1100. Specifically, it can be realized by appropriately using a stationary flat panel display, a head-mounted display, a video projector, or the like. When realized by a head-mounted display, it may be configured to also serve as a goggle-type eye tracker 1202.

The operation screen is a simulation screen that includes various information displays on the state of the cab of a train traveling in a predetermined operation section in which a railway signal is installed at a predetermined position and the scenery / landscape seen from the window of the cab. The railroad signal indicates a condition for operating a train by a display or a display, and includes signals such as traffic lights, signals, signs, and the like.

FIG. 2 shows a screen example of the operation screen. In the present embodiment, the operation screen W1 displays the line-of-sight position (training user line-of-sight position) Pr of the training user, which is tracked and detected during the operation simulation. The training user line-of-sight position Pr is, for example, a position where the line-of-sight of the training user detected by the eye tracker 1202 penetrates the driving screen W1.

The operation console 1206 is an operation input device that simulates the driver's seat of an actual train, and is provided with, for example, an input lever corresponding to a mascon, and can transmit an operation input signal to the computer 1100. Further, the operation console 1206 includes an instrument rack 1208 in which an instrument such as a speedometer and switches are arranged. However, the instrument rack 1208 does not have to be integrated with the operation console 1206 provided with an input lever or the like, and may be a separate body.

[principle]
In the present embodiment, the train driving simulator 1000 performs a gaze object specifying process for specifying where the line of sight of the training user is directed for each simulation running position during the execution of the driving simulation. Then, after executing the driving simulation, predetermined statistical processing is performed, and control is performed to display the gaze result of the training user during the simulation.

(1) Gaze Object Identification Process FIG. 3 is a diagram for explaining the gaze object identification process, and shows the position information of an object defined for the virtual landscape image at the moment shown in FIG. 2 in an exemplary manner. In the present embodiment, the position information of a predetermined type of object included in the driving screen (virtual landscape image) at the time of traveling at the simulation traveling position is set in advance for each simulation traveling position.

The predetermined type of object includes at least an object related to a railway signal and an object related to a railroad track. In the present embodiment, among the objects related to the railway signal, the object related to the signal (signal object) and the object related to the sign (marking object), the object related to the line, the object related to the vicinity of the line (the object near the line), and the object. Six types of objects, an object related to the front of the line (object in front of the line), an object related to the landscape (landscape object), and other area objects, are specified by the gaze object identification process. Then, the position information is set in advance for each area of the signal object, the sign object, the landscape object, and the other area object, and the area of the entire line which is the area of the line vicinity object or the line front object. The types of objects are not limited to the six types shown in the examples, and may be set as appropriate.

Specifically, as illustrated in FIG. 3, the flag information indicating the signal object is set in the signal area A21 in the virtual landscape image, and the flag information indicating the line object is set in the line area A23. Flag information indicating a landscape object is set in the landscape area A25. Further, flag information indicating a sign object is set in the area of the sign, and flag information indicating other area objects is set in the area not belonging to any of these.

Then, in the gaze object identification process, during the execution of the driving simulation, it is first determined whether the line of sight of the training user is inside the driving screen or outside the driving screen at the current simulation running position, and if it is outside the driving screen, the simulated running position. While the gaze object of the training user in the above is specified as "outside the operation screen", in the case of the inside of the operation screen, the process of specifying the object in the operation screen to which the line of sight is directed is repeated as the gaze object. Specifically, if the object of the current training user line-of-sight position Pr is a signal object, a sign object, a landscape object, or another area object by referring to the position information of the object defined for the current simulation travel position. The object is used as a gaze object at the simulation traveling position. In the example of FIG. 2, since the training user line-of-sight position Pr belongs to the area A21 of the traffic light shown in FIG. 3, the gaze object at the simulated travel position is specified as a traffic light object.

After that, when the specified gaze object is a traffic light object, the traffic light gaze distance calculation process is performed to calculate the gaze distance from the current simulation running position to the traffic light object as the gaze object. In the present embodiment, the distance (traffic light distance) from the simulated running position to the traffic light object is set in advance for the simulated running position in which the traffic light object is included in the virtual landscape image. Then, the traffic light distance set for the current simulation travel position is defined as the gaze distance.

Further, when the object of the current training user's line-of-sight position Pr is a railroad track object, it is further specified whether it is a railroad track neighborhood object or a railroad track front object based on the distance from the simulated running position. The track near object refers to the area of the track object where the distance from the current simulated travel position is located on the short-distance side, and the track front object is the region ahead of the train traveling where the distance is located on the long-distance side. To say. In the present embodiment, the track area is divided into a short-distance side and a long-distance side of the current simulation running position using a predetermined distance threshold, and each area is designated as a track proximity object and a track front object. For example, when the distance corresponding to D2 in FIG. 3 is set as the distance threshold value, the front side is the line proximity object A231 and the back side is the line front object A233 with the broken line as the boundary. Therefore, if the position Pr1 shown in FIG. 2 is the line-of-sight position of the training user, the object in front of the track is specified as the gaze object.

More specifically, the distance threshold is set in advance for each speed range of the train in stages. FIG. 4 is a diagram showing an example of setting the distance threshold value. In the example of FIG. 4, the distance thresholds Ta, Tb, and Tc are set for each of the three speed ranges of low speed range, medium speed range, and high speed range. The value of this distance threshold value is such that the faster the speed range, the longer the distance (Tc> Tb> Ta). Then, the distance thresholds Ta, Tb, and Tc are selectively used according to which speed range the current simulation running speed belongs to, and the area of the railroad track in the virtual landscape image at the current simulation running position is used as the railroad track neighborhood object and After dividing into each area of the object in front of the track, the gaze point is specified. On the operation screen, the lower end of the screen is the position closest to the train, and the position becomes farther from the train as it goes to the upper part of the image. Therefore, the distance threshold value can also be set as the distance from the lower end of the screen of the operation screen.

According to the above-mentioned gaze object identification process, what the training user was looking at during the driving simulation, for example, looking at a traffic light, looking ahead in the direction of travel of the train, the scenery such as the sky, etc. It is possible to specify and record the type of gaze object, such as what was being seen, for each simulation travel position.

(2) Statistical processing In the statistical processing, statistical values related to the time during which a predetermined type of object is gazed are calculated based on the gaze object specified for each traveling position in the gaze object identification process during the execution of the driving simulation. .. In the present embodiment, the gaze object is extracted at each time interval (for example, every 0.1 seconds) at predetermined time intervals based on the start time of the driving simulation (at the start of the simulation run). Then, the types of objects such as "traffic light", "sign", "near the track", "front of the track", "landscape", and "others" and each item of "outside the operation screen" are set as gaze items, and the number of times they are extracted is separated. Count to.

More specifically, at that time, the statistical value for each gaze item in the target section preset as all or part of the driving section by the driving simulation is calculated. In the present embodiment, the driving section is divided into four target sections: a section at the time of departure from the station, a section for coasting operation, a section at the time of arrival at the station, and a section at the time of passing a railroad crossing. Count the number of extractions.

Then, the ratio of the counted values of "traffic light", "sign", "near the track", "front of the track", "landscape", "others" and "outside the operation screen" to the whole is calculated for each gaze item, and the corresponding target section is set. It shall be the statistical value of each related gaze item.

The statistical value is not limited to the statistical value related to the time being watched, and may be configured to calculate the statistical value related to the mileage being watched. Specifically, each time the gaze object is extracted, the traveling speed at that time is multiplied by the time interval for extracting the gaze object (for example, 0.1 second) to obtain the mileage in which the gaze object is being gazed. It may be calculated and recorded, and the objects of the gaze item and the mileage of the gaze outside the driving screen may be aggregated and used as a statistical value for each target section.

(3) Gaze result display control process FIG. 5 is a diagram showing a display example of the gaze result, and shows an example in which statistical values in a certain target section are made into a band graph. In the gaze result display control process, the statistical value calculated for each gaze item for each target section in the statistical process is converted into a band graph shown in FIG. 5, for example, and the display is controlled as the gaze result of the training user. According to this, it is possible to present to the training user the overall gaze tendency during the simulation for the object set as the gaze item immediately after the end of the driving simulation or at an arbitrary timing after the execution.

More specifically, in the gaze result display control process of the present embodiment, as shown in FIG. 5, the gaze result of the training user is based on the statistical value when a model user such as an instructor performs a driving simulation ( Display control is performed side by side with the model gaze result). The model gaze result is prepared in advance by acquiring the movement of the line of sight at the time of the demonstration of the driving simulation by the model user, calculating the statistical value in the same manner as described above. According to this, the training user can present the model gaze result of the model user in a manner of contrasting with his / her own gaze result. Therefore, it is possible to effectively teach the training user how to pay attention to an object that comes into view when the train is operated, such as a traffic light, a sign, or an object in front of the train in the traveling direction. For example, in the example of FIG. 5, the training user tends to look near the railroad track instead of the front of the railroad track, and is instructed / educated to look closely at the front of the railroad track like an expert, or the training user is instructed based on the gaze result. It is possible to instruct the operation simulation to be performed again. So to speak, it is possible to instruct the training user to correct the habit related to the line-of-sight tendency.

Further, in the present embodiment, the track area is divided into a short-distance side and a long-distance side from the current simulation running position, and the area ahead of the long-distance side in the traveling direction of the train is one of the gaze objects. It can be specified as a forward object. Generally, it is said that when driving at low speed, the vehicle looks closer than when driving at high speed, and it is desirable to set the range ahead in the traveling direction according to the speed range. According to the present embodiment, it is possible to set a distance threshold value for separating them according to the speed range, and it is possible to appropriately determine whether or not the user is looking ahead in the traveling direction at the simulated traveling position.

Further, in train operation, the driver's gaze behavior differs depending on the operation phase such as when departing from the station, coasting, arriving at the station, and passing a railroad crossing. For example, when departing from a station, work such as looking at the instrument rack or checking the timetable is performed, so that the ratio of the time when the line of sight is off from the front in the traveling direction of the train becomes relatively large. On the other hand, it is rare to lose sight of the line of sight from the front in the direction of travel during coasting, and it is important to monitor the front of the direction of travel and check traffic lights and signs. According to this embodiment, the gaze result can be presented for each operation phase. In addition, the model gaze result by the model user can be presented at the same time. According to this, the training user can easily grasp whether or not the line of sight is properly directed to the object to be watched, and it is effective for the training user to pay attention to the object suitable for the driving phase. It becomes possible to teach in a targeted manner.

In addition to the railroad signals and the situation ahead in the direction of travel, there are other things to see when driving a train, such as the instrument rack and timetable provided in the cab, other than outside the train window. According to the present embodiment, it is possible to determine whether the line of sight of the training user is inside the driving screen or outside the driving screen for each simulation running position, and to specify the outside of the driving screen as one of the gaze objects. Then, it is possible to calculate a statistical value related to the time or distance at which the user's line of sight is directed outside the operation screen on which the operation console 1206 and the instrument rack 1208 are installed, and present the gaze result to the user.

Note that FIG. 6 shows another display example of the gaze result. FIG. 6 shows an example in which the time zone in which the training user was looking is identified and displayed for each gaze item. The right direction toward FIG. 6 shows the passage of time, and the left end is the departure point. In this display example, the movement of the line of sight of the training user can be presented together with the gaze tendency of each gaze item. In addition, by displaying the model gaze results side by side, the movement of the gaze of the model user can be presented together, and it is possible to further instruct and educate the good or bad of the timing when the gaze is directed to the object to be gazed.

In addition, when operating a train, the distance to the gaze object when the line of sight is directed may be important. For example, in the case of a traffic light, it is a model to pay attention once when passing a signal calling position sign installed about 600 m in front of the traffic light, and then to pay attention when passing through the traffic light. This is to confirm that it may change to a "red light" between the time it passes the signal calling position sign and the time it passes the traffic light.

Therefore, for the "traffic light" among the gaze items, it is advisable to use the gaze distance and calculate the statistical value separately for the gaze from a distance and the gaze from a near distance. Specifically, the number of extractions related to gaze from a distance and the number of extractions related to gaze from near are separately counted according to a predetermined gaze distance threshold value. In this case, the count values of "traffic light (long-distance gaze)", "traffic light (short-distance gaze)", "sign", "near railroad track", "front of railroad track", "landscape", "others" and "outside the operation screen" account for the whole. The ratio is calculated for each gaze item and used as the statistical value of each gaze item related to the applicable target section. According to this, the gaze distance can be calculated when the traffic light object is the gaze object. Then, based on the calculated gaze distance, it is possible to calculate a statistical value when the traffic light is gazed from a distance and a statistical value when the traffic light is gazed from a close distance. Therefore, it is possible to determine whether the training user is not only gazing at the traffic light but also appropriately performing both gazing from a distance and gazing when passing through the traffic light.

[Functional configuration]
FIG. 7 is a block diagram showing a functional configuration example of the train operation simulator 1000 according to the present embodiment. As shown in FIG. 7, the train operation simulator 1000 includes a management operation input unit 100, an operation operation input unit 102, an eye tracking unit 104, a calculation unit 200, an image display unit 390, and a sound output unit 392. It is provided with a storage unit 500.

The management operation input unit 100 is a means for inputting various operations for managing the train operation simulator 1000. For example, it is realized by an operation input device such as a keyboard, a touch panel, a mouse, a touch pad, a lever, and a switch, and outputs an operation input signal to the calculation unit 200. In the example of FIG. 1, the keyboard 1106 corresponds to this.

The driving operation input unit 102 is a means for the user to input a driving operation. For example, it is realized by a switch, a lever, a dial, a touch panel, a pedal, a handle, or the like, and an operation input signal is output to the calculation unit 200. In the example of FIG. 1, the input lever and the like of the operation console 1206 correspond to this.

The eye tracking unit 104 performs so-called eye tracking, which tracks and detects the user's line of sight. Further, the eye tracking unit 104 performs so-called head tracking, which tracks and detects the orientation of the user's head. Then, the eye tracking unit 104 outputs the information indicating the line-of-sight direction or the position coordinates through which the line of sight penetrates the operation screen to the calculation unit 200 as the line-of-sight tracking result one by one. In the present embodiment, the latter is used, and if the line of sight of the training user is in the operation screen, the above-mentioned position coordinates are output to the calculation unit 200. On the other hand, when the line of sight of the training user is outside the driving screen, the flag information (flag outside the driving screen) indicating that the line of sight is outside the driving screen is output to the calculation unit 200 as the line-of-sight tracking result. In the example of FIG. 1, the eye tracker 1202 corresponds to this. When the computer 1100 executes a part or all of the calculation process of the information indicating the line-of-sight direction or the calculation process of the line-of-sight position coordinates, the control board 1150 also corresponds to this.

The arithmetic unit 200 is realized by, for example, a microprocessor such as a CPU or GPU, or an electronic component such as an ASIC or an IC memory, and performs input / output control of data with each functional unit. Then, various arithmetic processes are performed based on a predetermined program, various setting data, an eye tracking result from the eye tracking unit 104, an operation input signal from the management operation input unit 100 and the operation input unit 102, and the like, and a train operation simulator is performed. The operation of 1000 is controlled in an integrated manner. In the example of FIG. 1, the control board 1150 corresponds to this.

The calculation unit 200 of the present embodiment includes a simulation control unit 210, a timekeeping unit 280, a sound generation unit 292, and an image generation unit 290. Of course, functional parts other than these can be included as appropriate.

The simulation control unit 210 includes a training user line-of-sight position acquisition unit 212, an operation screen display control unit 214, a gaze object identification unit 216, a traffic light gaze distance calculation unit 218, a statistical processing unit 220, and a gaze result display control unit 222. And, various arithmetic processing related to the operation simulation is executed.

The training user line-of-sight position acquisition unit 212 acquires the line-of-sight tracking result (training user's line-of-sight position coordinates or driving off-screen flag) for each tracking cycle by the eye tracking unit 104 during execution of the driving simulation by the training user.

The operation screen display control unit 214 displays and controls the operation screen. In the present embodiment, the operation screen in which the current training user's line-of-sight position is identified and displayed on the virtual landscape image is displayed and controlled based on the line-of-sight tracking result acquired by the training user's line-of-sight position acquisition unit 212.

The gaze object specifying unit 216 performs the gaze object identification process during the execution of the driving simulation, and specifies the gaze object of the training user for each simulation running position.

The traffic light gaze distance calculation unit 218 performs a traffic light gaze distance calculation process when the gaze object identification unit 216 identifies the traffic light object as a gaze object, and calculates the distance from the current simulation travel position to the traffic light gaze distance as the traffic light gaze distance. do.

The statistical processing unit 220 performs statistical processing after executing the driving simulation, and for each target section of the section at the time of departure from the station, the section of coasting operation, the section at the time of arriving at the station, and the section at the time of passing the railroad crossing, a traffic light (long-distance gaze). , Traffic light (short-distance gaze), sign, near the railroad track, in front of the railroad track, landscape, etc. do.

The gaze result display control unit 222 controls to display the gaze result of the training user related to the corresponding driving simulation based on the statistical value obtained for each gaze item for each target section in the statistical processing.

The timekeeping unit 280 uses the system clock to measure the current date and time, the date and time in the simulation world, and various timers.

The image generation unit 290 can generate images related to the system management of the computer 1100, operation screens W2 to W8 which are simulation images, and the like. Then, an image signal for displaying the generated image can be output to the image display unit 390.

The sound generation unit 292 is realized by executing IC or software that generates and decodes voice data, and generates or decodes voice data such as operation sounds and environmental sounds related to system management and operation simulation of the computer 1100. Then, the audio signal is output to the sound output unit 392.

The image display unit 390 displays various images for system management and operation screens W2 to W8 based on the image signals input from the image generation unit 290. For example, it can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, and a head-mounted display. In the example of FIG. 1, the image related to the system management is displayed on the touch panel 1108, and the operation screen is displayed on the video monitor 1204.

The sound output unit 392 emits an audio signal input from the sound generation unit 292. In the example of FIG. 1, a speaker (not shown) included in the main unit 1101 and the touch panel 1108 corresponds to this.

In the storage unit 500, a program for operating the train operation simulator 1000 and realizing various functions included in the train operation simulator 1000, data used during execution of this program, and the like are stored or processed in advance. It is temporarily stored each time. For example, it is realized by an IC memory such as a RAM or a ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or a DVD, an online storage, or the like. In the example of FIG. 1, the IC memory 1152 mounted on the main unit 1101 corresponds to this.

FIG. 8 is a diagram showing an example of a program and data stored in the storage unit 500. The storage unit 500 stores the simulation program 501, the simulation environment initial setting data 510, the object position definition data 520 for each simulation environment, the distance threshold table 530, the target section setting 540 for each simulation environment, and the model gaze result data 550. I remember it in advance. Further, the storage unit 500 stores the training user line-of-sight tracking result data 560, the gaze object identification result data 570, the simulation control data 600, the gaze result data 700, and the current date and time 800 as data to be appropriately generated and updated. Remember. In addition, information such as timers, counters, and various flags can be stored as appropriate.

The simulation program 501 is a program for realizing the function as the simulation control unit 210 by being read and executed by the calculation unit 200.

The simulation environment initial setting data 510 is prepared for each environment condition of the operation simulation, and stores various data defining the contents of the operation simulation. For example, one simulation environment initial setting data 510 includes a traveling section type 511, a seasonal type 512, a weather type 513, and a time zone type 514. Further, the simulation environment initial setting data 510 includes environment object setting data 515, railway signal setting data 516, and corresponding position definition ID 517. Of course, data other than these can be included as appropriate.

The environment object setting data 515 is prepared mainly for each object (objects of buildings such as stations and buildings, objects constituting landscapes such as landscapes) arranged in the space to be simulated and mainly constitutes the background and environment, and the environment object setting data 515 is prepared for each object. Define model data, texture data, placement data, motion data, etc.

The railway signal setting data 516 is prepared for each railway signal arranged in the space to be simulated, and defines model data, texture data, arrangement position data, operation pattern data in the case of an operating railway signal, and the like.

The corresponding position definition ID 517 is an object position definition ID 521 (see FIG. 9) of the object position definition data 520 for each simulation environment that defines the operation screen (virtual landscape image) related to the operation simulation using the simulation environment initial setting data 510. Store.

The object position definition data 520 for each simulation environment is prepared for each environment condition of the driving simulation, and defines the position information of the object in the virtual landscape image displayed on the driving screen during the driving simulation. FIG. 9 is a diagram showing a data configuration example of the object position definition data 520 for each simulation environment. One object position definition data 520 for each simulation environment includes an object position definition ID 521 and an object position definition data 523, as shown in FIG. 9, for example. The object position definition data 523 is prepared for each simulation travel position of the driving simulation, and includes the simulation travel position 524, the object position information 525, and the traffic light distance 526.

The object position information 525 is the position information of each object of the signal object, the sign object, the landscape object, the area object of the entire track, and other area objects in the operation screen (virtual landscape image) when the corresponding simulation travel position 524 is traveled. (See Figure 3).

The traffic light distance 526 is set when the traffic light object is included in the operation screen (virtual landscape image) at the time of traveling of the corresponding simulation travel position 524, and the distance from the simulation travel position 524 to the traffic light object is set.

Returning to FIG. 8, in the distance threshold table 530, the distance threshold used when dividing the track area into the track object and the front object is set in association with the speed range of the train (see FIG. 4).

The target section setting 540 for each simulation environment is prepared for each environment condition of the driving simulation, and defines a section at the time of departure from the station, a section of coasting operation, a section at the time of arrival at the station, and a section at the time of passing a railroad crossing within the driving section.

The model gaze result data 550 is prepared for each environmental condition of the driving simulation, and stores the gaze result of the model user obtained by demonstrating the corresponding driving simulation by the model user.

The gaze object identification result data 570 stores the gaze object identification result for each simulation traveling position. FIG. 10 is a diagram showing a data configuration example of the gaze object identification result data 570. As shown in FIG. 10, in the gaze object identification result data 570, for each simulation running position of the running simulation, the gaze object specified by the gaze object identification process of the simulation running position and the gaze object are traffic lights. In the case of an object, the gaze distance calculated by the traffic light gaze distance calculation process is set.

The simulation control data 600 stores various data for executing and controlling the operation simulation. FIG. 11 is a diagram showing a data configuration example of the simulation control data 600. As shown in FIG. 11, for example, the simulation control data 600 includes a traveling section 602, a season 604, a weather 606, a time zone 608, a used position definition ID 610, a simulation elapsed time 612, and a simulation traveling position 614. Includes a simulated travel speed of 616. It also includes current training user line-of-sight position coordinates 618, environment object control data 620, railroad signal control data 622, and operation screen data 624. Of course, data other than these can be included as appropriate.

The traveling section 602, the season 604, the weather 606, and the time zone 608 are the environmental conditions of the driving simulation. Before the start of the simulation, a predetermined environmental condition selection screen is displayed and the selection input of each of these items is accepted. The result.

The simulation elapsed time 612 is the elapsed time from the start of the simulation. The simulated running position 614 and the simulated running speed 616 store the running position and running speed of the virtual train simulated according to the driving operation input by the operation console 1206 (see FIG. 1), respectively.

The current training user line-of-sight position coordinates 618 stores the line-of-sight position coordinates indicated by the line-of-sight tracking result acquired by the training user line-of-sight position acquisition unit 215a.

The environment object control data 620 is prepared for each object of the environment object setting data 515 of the simulation environment initial setting data 510 to which the traveling section 602, the season 604, and the weather 606 match, and is for controlling their states during the simulation execution. Store the data of.

The railway signal control data 622 is prepared for each object of the railway signal setting data 516 of the simulation environment initial setting data 510 to which the traveling section 602, the season 604, and the weather 606 match, and is used to control their states during the simulation execution. Store the data of.

Returning to FIG. 8, the gaze result data 700 is prepared for each executed driving simulation, and the statistical value calculated by the statistical processing after the execution is stored as the gaze result of the training user in the driving simulation.

[Processing flow]
FIG. 12 is a flowchart for explaining the flow of processing in the train operation simulator 1000 of the present embodiment. The process described here is realized by the arithmetic unit 200 reading and executing the simulation program 501.

In the present embodiment, the computer 1100 of the train operation simulator 1000 first displays and controls a predetermined simulation environment screen, and accepts the setting input of the environmental conditions of the operation simulation (step S1). Specifically, the operation of selecting the traveling section, the season, the weather, and the time zone is received, and these are stored in the simulation control data 600 as the traveling section 602, the season 604, the weather 606, and the time zone 608.

Subsequently, the computer 1100 reads out the simulation environment initial setting data 510 that matches the environment condition setting in step S1, and defines the object position for each simulation environment corresponding to the simulation environment initial setting data 510 according to the corresponding position definition ID 517. Read the data 520 (step S2). At this time, the corresponding position definition ID 517 is stored in the simulation control data 600 as the used position definition ID 610.

After that, the operation simulation is started (step S3). As a result, the time counting of the simulation elapsed time 612 is started, and the simulation running position 614 and the simulation running speed 616 are simulated. The environmental object control data 620 and the railway signal control data 622 are also changed according to the progress of the simulation. Further, the training user line-of-sight position acquisition unit 212 starts acquiring the line-of-sight tracking result by the eye tracking unit 104 (step S4). As a result, the line-of-sight tracking result is accumulated in the training user line-of-sight tracking result data 560 in the tracking cycle of the eye tracking unit 104, and the current training user line-of-sight position coordinate 618 is changed. If the line-of-sight tracking result is the line-of-sight position coordinates of the training user, the current training user line-of-sight position coordinates 618 is changed at the coordinates, and if the flag is off the operation screen, the current training user line-of-sight position coordinates 618 is cleared.

Then, when the operation simulation is started, the computer 1100 repeats the processing related to the display of the operation screen and the identification of the gaze object until the simulation is completed (steps S5 to S6).

Specifically, the computer 1100 performs an operation screen generation display process (step S5). In the operation screen generation display processing of the present embodiment, the operation screen in which the current training user line-of-sight position is identified and displayed on the virtual landscape image is generated and displayed according to the current training user line-of-sight position coordinates 618.

Further, the computer 1100 performs a gaze object identification process (step S6). FIG. 13 is a flowchart for explaining the flow of the gaze object specifying process. As shown in FIG. 13, in the gaze object specifying process, first, it is determined whether or not the line of sight of the training user is within the operation screen generated / displayed in step S5 of FIG. 12 based on the current training user line-of-sight position coordinates 618. Then, in the case of outside the driving screen (step S601: NO), the gaze object of the training user at the current simulation running position is specified as "outside the driving screen" (step S603).

When the line of sight of the training user is in the operation screen (step S601: YES), the current simulation running position 614 is set in the simulation running position 524 in the object position definition data 520 for each simulation environment read in step S2 of FIG. With reference to the object position information 525, the object of the current training user's line-of-sight position coordinates is specified (step S605). If the specified object is not a railroad track object but a signal object, a sign object, a landscape object, or another area object (step S607: NO), that object is used as a gaze object at the simulation travel position (step S609). ..

If the gaze object specified in step S605 is a traffic light object (step S611: YES), the traffic light gaze distance calculation process is performed to calculate the gaze distance from the current simulation travel position to the traffic light object as the gaze object. (Step S613).

On the other hand, if the object specified in step S605 is a track object (step S607: YES), the distance threshold value in the speed range to which the current simulation running speed 616 belongs is read out from the distance threshold value table 530 (step S615). Subsequently, the distance from the current simulation running position 614 to the position in the track indicated by the current training user line-of-sight position coordinates 618 is calculated (step S617). Then, the distance calculated in step S617 is determined as a threshold value using the distance threshold value read in step S615, and is specified as a track near object if it is on the short distance side and as a track front object if it is on the long distance side with the distance threshold as the boundary. (Step S619).

After that, the specified object and the calculated gaze distance are stored in the gaze object identification result data 570 in association with the current simulation travel position, and the gaze object identification process related to the current simulation travel position is completed.

Returning to FIG. 12, the computer 1100 returns to step S5 and repeats the above process while the end condition of the operation simulation is not satisfied (step S7: NO). Then, when the end condition of the operation simulation is satisfied (step S7: YES), the execution of the operation simulation is terminated and statistical processing is performed (step S8).

FIG. 14 is a flowchart for explaining the flow of statistical processing. As shown in FIG. 14, in the statistical processing, first, the operation section is divided into the target sections according to the corresponding target section setting 540 for each simulation environment (step S81). Then, the loop A processing is performed with each target section as a processing target section (step S83 to step S87).

That is, in loop A, "traffic light (long-distance gaze)", "traffic light (short-distance gaze)", "sign", "near the railroad track", and "railroad track" based on the gaze object specified for each simulation running position in the processing target section. Statistical values are calculated for each gaze item of "forward", "landscape", "others", and "outside the driving screen" (step S85). When the processing of loop A is performed for all the target sections, the statistical processing is completed.

Then, returning to FIG. 12, the gaze result display control process is performed, and the gaze result is displayed on the image display unit 390 based on the statistical value calculated in the statistical process of step S8 (step S9). At that time, the model gaze result data 550 related to the corresponding driving simulation is used to display and control the model gaze result of the model user along with the gaze result of the training user. After the gaze result display control process, the computer 1100 ends a series of processes.

As described above, according to the present embodiment, the user's gaze object can be specified for each traveling position during the execution of the driving simulation. Then, after the execution of the driving simulation, it is possible to calculate the statistical value related to the time or distance at which the predetermined type of object (object) was gazed and control the display of the gaze result, and when the train is operated by the driving simulation. The gaze tendency can be presented to the user. It is possible to show the user's gaze tendency as a whole in the simulated driving as a whole.

In the above-described embodiment, the distance threshold value used to specify whether the track object is the object near the track or the object in front of the track is set for each speed range. Instead of this, the distance threshold value may be set for each target section. Alternatively, the speed range may be defined for each target section, and the distance threshold value may be set for each target section and each speed range.

In the above embodiment, when the line of sight of the training user is outside the driving screen in the gaze object identification process, it is specified as "outside the driving screen" as it is, but "outside the driving screen" is further subdivided. It may be specified. For example, as shown in FIG. 2, it is assumed that the operation console 1206 and the instrument rack 1208 are arranged under the video monitor 1204 on which the operation screen is displayed from the viewpoint of the training user. Then, when the line of sight of the training user is determined to be outside the driving screen, the direction of the head of the training user detected by the eye tracker 1202 (eye tracking unit 104) is directed downward from the video monitor 1204. If it is determined, the gaze object identification unit 216 identifies the gaze object as an "operation console or instrument rack".

Further, the same processing can be performed even when the arrangement position of the timetable (timetable) or the like is on the left side of the video monitor 1204. That is, when it is determined that the line of sight of the training user is outside the driving screen and the direction of the head of the training user is determined to be to the left of the video monitor 1204, the gaze object identification unit 216 gazes. An object can be identified as a "diamond".

Then, the statistical processing unit 220 can calculate a statistical value related to the time or distance of the gaze for each gaze object (object) that is further subdivided "outside the operation screen".

Further, in the line-of-sight detection by the eye tracker 1202, a detection error may occur momentarily / temporarily due to the influence of blinking (blinking) or the like. At that time, depending on whether the direction of the head is "inside the operation screen" or "outside the operation screen", it is possible to confirm in the internal calculation whether or not it is a momentary / temporary detection error.

100 ... Management operation input unit 102 ... Operation operation input unit 104 ... Eye tracking unit 200 ... Calculation unit 210 ... Simulation control unit 212 ... Training user line-of-sight position acquisition unit 214 ... Operation screen display control unit 216 ... Gaze object identification unit 218 ... Signal device Gaze distance calculation unit 220 ... Statistical processing unit 222 ... Gaze result display control unit 500 ... Storage unit 501 ... Simulation program 510 ... Simulation environment initial setting data 520 ... Simulation environment-specific object position definition data 530 ... Distance threshold table 540 ... Simulation environment Target section setting 550 ... Model gaze result data 560 ... Training user gaze tracking result data 570 ... Gaze object identification result data 600 ... Simulation control data 700 ... Gaze result data 1000 ... Train operation simulator 1100 ... Computer 1150 ... Control board 1202 ... Eye tracker 1204 ... Video monitor 1206 ... Operator console 1208 ... Instrument rack W1 ... Operation screen Pr ... Training user line-of-sight position

Claims (6)

It is a program for displaying a driving screen and executing a train driving simulation on a computer equipped with an eye tracking means for tracking and detecting the user's line of sight.
A gaze object specifying means for specifying an object in the driving screen to which the user's line of sight is directed at the current driving position as a gaze object at the driving position during execution of the driving simulation.
After executing the driving simulation, a predetermined statistical process is performed based on the gaze object for each traveling position specified by the gaze object specifying means, and a statistical value related to the time or distance at which the object of a predetermined type is gazed is obtained. Statistical processing means to calculate,
A display control means for displaying and controlling the gaze result based on the statistical value.
To make the computer function as
The predetermined type of object includes at least an object related to a railroad track.
The objects related to the railroad track are the object related to the vicinity of the railroad track where the distance from the current running position is located on the short distance side based on the predetermined distance threshold, and the distance from the current running position based on the distance threshold is the long distance side. There is an object related to the front of the railroad track located in
The distance threshold is determined according to the speed of the train.
When the object to which the user's line of sight is directed is an object related to the railroad track, the gaze object identifying means uses the distance threshold value according to the current traveling speed to determine the object related to the vicinity of the railroad track or the railroad track. By further specifying whether it is an object related to the front, the gaze object is specified, and the gaze object is specified.
The statistical processing means calculates the statistical value related to the gaze of an object related to the vicinity of the railroad track and the statistical value related to the gaze of an object related to the front of the railroad track.
Program for. The predetermined type of object includes an object related to a traffic light.
When the gaze object specified by the gaze object specifying means is an object related to the traffic light, the gaze distance from the traveling position when the user's line of sight is directed to the gaze object is determined. Traffic light gaze distance calculation means to calculate,
To further function the computer as
The statistical processing means calculates the statistical value related to the gaze of the object related to the traffic light by dividing it into predetermined classifications based on the gaze distance.
The program according to claim 1. The computer comprises a console and / or instrument rack for the driving simulation.
The statistical processing means further calculates a statistical value relating to the time or distance when the user's line of sight is out of the driving screen while the driving simulation is being executed.
The program according to claim 1 or 2 . The display control means further displays and controls the model gaze result based on the statistical value when the model user performs the driving simulation.
The program according to any one of claims 1 to 3 . As the statistical processing, the statistical processing means calculates the gaze object for each traveling position specified by the gaze object specifying means for each gaze item.
The display control means sets the horizontal axis as the time elapsed of the driving simulation, and displays and controls a graph for each gaze item that identifies and displays the time zone in which the object of the type corresponding to the gaze item was gaze.
The program according to any one of claims 1 to 4 . A train driving simulator that displays a driving screen and executes a train driving simulation.
An eye tracking means for tracking and detecting the user's line of sight during the execution of the driving simulation,
During the execution of the driving simulation, the gaze object specifying means for specifying the object in the driving screen to which the user's line of sight is directed at the current driving position as the gaze object at the driving position,
After executing the driving simulation, a predetermined statistical process is performed based on the gaze object for each traveling position specified by the gaze object specifying means, and a statistical value related to the time or distance at which the object of a predetermined type is gazed is obtained. Statistical processing means to calculate and
A display control means for displaying and controlling the gaze result based on the statistical value,
Equipped with
The predetermined type of object includes at least an object related to a railroad track.
The objects related to the railroad track are the object related to the vicinity of the railroad track where the distance from the current running position is located on the short distance side based on the predetermined distance threshold, and the distance from the current running position based on the distance threshold is the long distance side. There is an object related to the front of the track located in
The distance threshold is determined according to the speed of the train.
When the object to which the user's line of sight is directed is an object related to the railroad track, the gaze object identifying means uses the distance threshold value according to the current traveling speed to determine the object related to the vicinity of the railroad track or the railroad track. By further specifying whether it is an object related to the front, the gaze object is specified, and the gaze object is specified.
The statistical processing means calculates the statistical value related to the gaze of an object related to the vicinity of the railroad track and the statistical value related to the gaze of an object related to the front of the railroad track.
Train driving simulator.

Images