JP2014071319A - Railroad simulator and method for simulating driving of railroad - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a railroad simulator for evaluating a confirmation action carried out by a trainee by varying according to a simulation driving condition of a railroad vehicle.SOLUTION: The railroad simulator 10 includes: an imaging unit 32 for simulating a simulation driving of a railroad vehicle based on a driving scenario and imaging a trainee, a voice input unit 31a for inputting a voice, or a view point detection unit 30 for detecting a position of the view point; an evaluation unit 12 for evaluating based on an evaluation standard a finger pointing action of the trainee detected based on an image imaged by the imaging unit 32, a character string converted by having the voice input unit 31a recognize the inputted voice, or the position of the view point detected by the view point detection unit 30; and an evaluation standard varying unit 14 for varying the evaluation standard according to a simulation driving state of the railroad vehicle.

Description

  The present invention relates to a railway simulator and a method for simulating railway operation.

  Conventionally, a railway simulator for training the operation of a railway vehicle has been used. A trainer who trains the driving of the vehicle learns the operation of the vehicle by operating such a railway simulator and performing a simulated driving of the vehicle.

  In addition, the trainer learns to perform a confirmation operation of pointing, calling, and directing a gaze at a predetermined confirmation item in order to operate the railway vehicle safely.

  The trainer can perform safe operation of the vehicle more reliably by acquiring these confirmation operations.

Japanese Patent Laid-Open No. 03-175477

  By the way, the trainer who performs the simulated driving may perform the above-described confirmation items while the vehicle is traveling. For example, the trainer performs a confirmation operation on the traffic light while the vehicle is running.

  However, since the traveling speed of the vehicle is not constant, it is conceivable that the time margin for the trainer to perform the confirmation operation varies depending on the traveling speed.

  Therefore, when evaluating the confirmation operation performed by the trainee, the evaluation standard of the confirmation operation is changed according to the simulated driving situation such as the traveling speed of the vehicle, and the trainer performs based on the changed evaluation standard. It is desirable that the confirmation operation is evaluated.

  The present specification provides a railway simulator for evaluating a confirmation operation performed by a trainer by changing an evaluation standard of a confirmation operation performed by a trainer who trains a simulated train operation according to a simulated operation state of a railway vehicle. For the purpose.

  Also, in this specification, the railway operation for evaluating the confirmation operation performed by the trainer by changing the evaluation standard of the confirmation operation performed by the trainer who trains the simulated train operation according to the simulated operation state of the railway vehicle. It is an object to provide a method for simulating.

  According to the railway simulator disclosed in the present specification, a railway simulator that simulates simulated driving of a railway vehicle based on a driving scenario, an imaging unit that images a trainee, or a voice input unit that inputs voice, Alternatively, a viewpoint detection unit that detects the position of the viewpoint and a trainer's pointing operation detected based on an image captured by the imaging unit, or a character string that is converted by recognizing the voice input by the voice input unit, Or the evaluation part which evaluates the position of the viewpoint which the said viewpoint detection part detected based on the evaluation reference | standard, and the evaluation reference | standard change part which changes the said evaluation reference | standard according to the simulation driving condition of a railway vehicle are provided.

  In addition, according to the method of simulating railway operation disclosed in this specification, a simulated operation of a railway vehicle is a method of simulating railway operation based on a driving scenario, and an image obtained by imaging a trainee Detecting the trainee's pointing action based on the above, or detecting the position of the viewpoint using the viewpoint detection unit, or inputting the voice spoken by the trainer using the voice input unit and recognizing it as a character string, The computer executes the evaluation of the detected pointing operation or the position of the viewpoint or the recognized character string based on the evaluation standard that is changed according to the simulated driving situation of the railway vehicle.

  According to the simulator disclosed in the present specification described above, the confirmation operation performed by the trainer by changing the evaluation standard of the confirmation operation performed by the trainer who trains the simulated train operation according to the simulated operation state of the railway vehicle. Can be evaluated.

  Further, according to the simulation method disclosed in the present specification, the evaluation standard of the confirmation operation performed by the trainer who trains the simulated driving of the railway is changed according to the simulated driving situation of the railway vehicle, and the trainer The confirmation operation to be performed can be evaluated.

It is a functional block diagram showing one embodiment of a railroad simulator disclosed in this specification. It is a figure which shows the display part of the railroad simulator disclosed to this specification. It is a figure which shows a mode that the trainee is operating the railroad simulator disclosed to this specification. It is a figure explaining the simulator main part of the railroad simulator indicated to this specification. It is a figure which shows the data structure recorded on a scenario recording part. It is a figure which shows the data structure recorded on a training result recording part. It is a figure which shows the data structure recorded on a character string recording part. It is a flowchart explaining an example of operation | movement of the railroad simulator disclosed to this specification. It is a flowchart explaining another example of operation | movement of the railroad simulator disclosed to this specification.

  Hereinafter, a preferred embodiment of a railway simulator disclosed in the present specification will be described with reference to the drawings. However, the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and equivalents thereof.

  FIG. 1 is a functional block diagram illustrating an embodiment of a railway simulator disclosed in the present specification. FIG. 2 is a diagram illustrating a display unit of the railway simulator disclosed in the present specification. FIG. 3 is a diagram illustrating a state where a trainee is operating the railway simulator disclosed in the present specification.

  The train simulator 10 according to the present embodiment is for a trainer to learn a vehicle driving technique by performing a simulated operation of a rail vehicle in order to train a driver who operates the rail vehicle.

  Based on the driving scenario, the railway simulator 10 displays a simulated view image that can be seen from the cockpit of the railway vehicle and the simulated driving status such as the speed of the vehicle, and allows the trainee to operate an operation input device such as a master controller. To do.

  In addition, the railway simulator 10 evaluates the confirmation operation with respect to predetermined confirmation items performed by the trainer during the simulation operation, and records the evaluation result. The trainer can reproduce and check the simulated driving performed by himself / herself based on the recorded evaluation result. In addition, the trainer can reproduce the simulated driving performed by himself / herself and also train the same simulated driving again.

  This confirmation operation includes, for example, an operation such as a pointing operation performed by the trainee, a voice spoken by the trainee such as a call, or a position of a viewpoint that the trainer points toward the object.

  These confirmation operations can be performed on a predetermined object or event. The predetermined object or event includes, for example, a traffic light, a time at which the station departs from the timetable, a door-stop display lamp, a safety instrument, and a traveling track.

  The railway simulator 10 has each functional block shown in FIG. Next, each functional block of the railway simulator 10 will be described below with reference to FIG.

  The scenario reproducing unit 17 reproduces a simulated view image based on the driving scenario recorded in the scenario recording unit 20 and displays it on the display unit 40. The scenario playback unit 17 inputs operation information from the operation input unit 41 and changes the playback speed.

  The scenario recording unit 20 records an operation scenario used for training. The driving scenario includes a simulated view image reproduced by the scenario reproducing unit 17. The simulated view image is associated with information such as an object on which the trainee performs a confirmation operation.

  The display unit 40 displays a simulated view image reproduced by the scenario reproducing unit 17. In the example illustrated in FIG. 2, the display unit 40 includes a display 40 a that displays a simulated visual field image including the trajectory 40 b and the three display traffic signals 40 c.

  Further, the display unit 40 displays a simulated driving situation such as the traveling speed of the railway vehicle output from the scenario reproducing unit 17. In the example illustrated in FIG. 2, the display unit 40 includes a speedometer 50 a that displays the traveling speed of the railway vehicle. The speedometer 50a is disposed on the instrument panel 50 located below the display 40a.

  The simulated driving situation may include, for example, vehicle driving information such as speed or lighting state of a door-stop lamp, and driving operation information of a trainer such as a master controller.

  The operation input unit 41 includes a master controller 52 that controls the traveling speed of the railway vehicle in the simulated operation. In the example shown in FIG. 2, the master controller 52 is disposed on the operation panel 51 located below the instrument panel 50. The trainee P sits on the seat 54 and operates the master controller 52 and the like while watching the simulated view image displayed on the display 40a.

  The viewpoint detection unit 30 detects the position E of the viewpoint of the trainee P. The viewpoint detection unit 30 irradiates the trainee P with electromagnetic waves having a wavelength that cannot be visually recognized by the trainee P, receives the reflected electromagnetic waves, and detects the positions of the eyes of the trainee P and the eyes of each eye. To do. And the viewpoint detection part 30 detects the position E of the trainee's P viewpoint based on the correction information with respect to the trainee P input beforehand, the dimension information of the display 40a, the instrument panel 50, the operation panel 51, etc. . The viewpoint detection unit 30 outputs the viewpoint E of the trainee P to the evaluation unit 12. The detected viewpoint detection unit 30 can be configured using a known technique, for example.

  The speech recognition unit 31 includes a speech input unit 31a that inputs speech such as a call made by a trainee, and a character string converting unit 31b that recognizes the speech input by the speech input unit 31a and converts it into a character string. . The voice recognition unit 31 outputs the recognized character string to the evaluation unit 12. The voice recognition unit 31 can be configured using, for example, a known voice recognition technique. In the example shown in FIG. 2, the microphone as the voice input unit 31a is arranged on the display 40a, and inputs a voice F such as a call made by the trainee P. The voice recognition unit 31 quantifies and outputs the volume of the voice F spoken by the trainee. The function of the character string converting unit 31b may be included in the evaluation unit 12 described later.

  The stereo image capturing unit 32 captures a stereo image of the trainee P, generates a distance image, and outputs the generated distance image to the evaluation unit 12. Here, the distance image means an image having, as information, the distance between the stereo image capturing unit 32 and the captured object for each pixel of the stereo image. In the example illustrated in FIGS. 2 and 3, the stereo image capturing unit 32 is disposed on the display 40 a and captures the trainee P. The stereo image imaging unit 32 can be configured using, for example, a known imaging technique. The distance image may be detected using other sensors.

  The initializing unit 11 initializes the viewpoint detection unit 30, the voice recognition unit 31, and the stereo image capturing unit 32 described above corresponding to the trainee when a trainee operates the railway simulator 10 for the first time. The initialization value is recorded in the initialization value recording unit 21 in association with the ID that is the identification information of the trainee. The trainee's ID is input from the ID input unit 42 to the initialization unit 11.

  The initialization operation of the viewpoint detection unit 30 is performed, for example, by displaying a plurality of images on the display 40a and having the trainee visually recognize each image in turn. Thereby, individual-specific information such as the shape of the trainee's eyes can be obtained as a correction value.

  The initialization operation of the speech recognition unit 31 can, for example, cause a trainee to speak a predetermined example sentence, input the utterance, and obtain individual-specific information such as the trainee's voice as a correction value. By this initialization operation, for example, the voice input unit 31a corrects the voice input level, and the character string converting unit 32a corrects the parameter for recognizing the voice.

  The initialization operation of the stereo image capturing unit 32 is performed, for example, by having a trainee perform a pointing operation, capturing a stereo image of the motion, and obtaining individual-specific information such as the trainer's hands and arms as correction values. be able to.

  When the same trainee operates the railway simulator 10 again, the viewpoint detection unit 30, the voice recognition unit 31, and the stereo image recorded in the initialization value recording unit 21 based on the input trainee ID. The initialization value of the imaging unit 32 is read, and the viewpoint detection unit 30, the voice recognition unit 31, and the stereo image imaging unit 32 are initialized.

  Therefore, it is possible to omit the work of initializing again for the trainee who has been initialized once.

  Based on the driving scenario recorded in the scenario recording unit 20, the evaluation unit 12 recognizes the detected pointing action or the voice input by the voice recognition unit 31 and converts it into a character string or a viewpoint detection unit The position of the viewpoint detected by 30 is evaluated based on a predetermined evaluation criterion. The evaluation unit 12 receives an operation scenario that is read out and output from the scenario recording unit 20 by the scenario reproducing unit 17 and is evaluated in association with the operation scenario.

  As will be described in detail later, the driving scenario includes information such as an object on which the trainee performs a confirmation operation. The evaluation unit 12 includes, for each object, the presence / absence and timing of the detected pointing operation, the character string converted from the speech recognized by the speech recognition unit 31 and the sound volume and timing, and the viewpoint detection unit. The position of the viewpoint detected by 30 and its timing are evaluated based on a predetermined evaluation criterion.

  The evaluation unit 12 receives the distance image generated by the stereo image capturing unit 32, and separates the trainer P and the background portion that is not the trainer based on the input distance image. When the trainee P performs a pointing operation, since there is nothing other than the hand and the arm in the space where the pointing operation is performed, the evaluation unit 12 has an area having a predetermined length and width in the space. If it exists, the area is detected as the hand and arm of the trainee P. And the evaluation part 12 judges the presence or absence of a pointing operation, and its timing based on the image area | region of the trainer P's detected hand and arm. Further, the evaluation unit 12 corrects the parameters for detecting the image areas of the hands and arms of the trainee P by the above-described initialization operation. This corrected parameter is also recorded in the initialization value recording unit 21 in association with the ID that is the identification information of the trainee.

  In the present embodiment, the evaluation unit 12 detects the movement amount of the hand and arm detected during a predetermined time based on the detected image area of the hand and arm of the trainee P. Then, the evaluation unit 12 determines the presence / absence of a pointing operation based on the detected movement amount of the hand and arm. Note that the evaluation unit 12 may determine the pointing operation by performing processing different from the above-described operation.

  Further, when the evaluation unit 12 evaluates the voice recognized by the voice recognition unit 31, the character string recording unit 22 records the character string that the voice recognition unit 31 recognizes the voice and converts it into a character string. Evaluate based on columns.

  The character string recording unit 22 records a reference character string associated with an object or the like on which a trainee performs a confirmation operation. When evaluating the speech recognized by the speech recognition unit 31, the evaluation unit 12 evaluates each object or the like based on the reference character string recorded in the character string recording unit 22.

  The evaluation standard changing unit 14 changes the evaluation standard used by the evaluation unit 12 according to the simulated driving situation of the railway vehicle. In the present embodiment, the simulated driving situation is the speed of the railway vehicle, and the evaluation criterion changing unit 14 changes the evaluation criterion according to the traveling speed of the railway vehicle. The evaluation standard changing unit 14 receives a simulated driving situation such as a traveling speed of the railway from the scenario reproducing unit 17.

  Specifically, the evaluation criterion described above is the distance between the position of the railway vehicle at which the evaluation unit 12 starts the evaluation and the object to which the sight line is directed or the voice of the pointing operation or the call or the like. The starting distance. The evaluation standard changing unit 14 changes the starting distance according to the traveling speed of the railway vehicle, and the evaluating unit 12 starts the evaluation after the position of the railway vehicle approaches the starting distance or less with respect to the object. . The starting distance as the evaluation standard can be increased when the traveling speed of the railway vehicle is high and shortened when the traveling speed is low. The railway simulator 10 evaluates whether the trainer can perform the confirmation operation at an appropriate timing by changing the start distance according to the traveling speed of the railway vehicle. For example, even if the trainee performs the confirmation operation, if the trainer does not perform the confirmation operation, the confirmation operation is not evaluated.

  In addition, the evaluation criterion may be a movement amount for determining the presence / absence of a pointing operation. The amount of movement for determining the presence / absence of this pointing operation is used as a predetermined threshold used by the evaluation unit 12. The evaluation unit 12 determines that the pointing operation has been performed when the detected movement amount of the hand and arm is larger than a predetermined threshold. The amount of movement for determining the presence or absence of the pointing operation as the evaluation criterion can be increased when the traveling speed, which is a simulated driving situation of the railway vehicle, is high, and can be decreased when the traveling speed is low.

  The evaluation criterion may be the degree of coincidence between the character string obtained by recognizing and converting the voice input by the voice recognition unit 31 and the reference character string recorded in the character string recording unit 22. If the character string converted by recognizing and converting the voice input by the voice recognition unit 31 and the reference character string are equal to or higher than a predetermined matching degree, the evaluation unit 12 determines that the trainee has made a correct call. The degree of coincidence as the evaluation standard can be lowered when the traveling speed, which is a simulated driving situation of the railway vehicle, is high, and can be increased when the traveling speed is slow.

  Furthermore, the evaluation criterion may be the distance between the position of the viewpoint on the display 40a and the object to which the line of sight is directed. If the distance between the viewpoint position on the display 40a and the object to which the line of sight is directed is equal to or less than a predetermined threshold, the evaluation unit 12 determines that the trainee has correctly directed the line of sight to the object. . The distance as the evaluation standard can be increased when the traveling speed, which is a simulated driving situation of the railway vehicle, is high, and can be decreased when the traveling speed is low. The distance as the evaluation criterion is preferably increased when the moving speed of the object on the display is fast and shortened when the moving speed is slow.

  The recording processing unit 13 recognizes the pointing operation detected by the evaluation unit 12, the character string obtained by recognizing the voice input by the voice recognition unit 31, the position of the viewpoint detected by the viewpoint detection unit 30, and the like. The result evaluated based on the evaluation criteria is recorded in the training result recording unit 23 in association with the driving scenario being reproduced by the scenario reproducing unit 17.

  The training result recording unit 23 records the result of the evaluation by the evaluation unit 12 that is associated with the driving scenario reproduced by the scenario reproduction unit 17 by the recording processing unit 13 together with the trainer ID.

  The reproduction location detection unit 15 detects, for each trainer, a reproduction location to be reproduced in the driving scenario based on the trainee ID and the evaluation result recorded in the training result recording unit 23. Specifically, the playback location detection unit 15 detects the pointing operation detected by the evaluation unit 12, or the character string formed by recognizing the voice input by the voice recognition unit 31 or the viewpoint detection unit 30. For the position of the viewpoint, etc., a driving scenario of a part such as an object that has not been evaluated as having been performed correctly by the trainer is detected.

  In addition, the reproduction point detection unit 15 outputs a reproduction point to be reproduced of the detected driving scenario to the scenario reproduction unit 17. The scenario reproducing unit 17 outputs the portion of the driving scenario to be reproduced to the display unit 40 when the reproducing portion to be reproduced of the driving scenario detected by the reproduction point detecting unit 15 is input.

  When the position of the trainee's viewpoint is included in the display 40a, the viewpoint playback unit 16 may display the position of the trainee's viewpoint on the display 40a together with the simulated view image. When the evaluation unit 12 detects the direction pointed by the trainee, the viewpoint reproduction unit 16 may display the position on the display 40a pointed to by the trainee on the display 40a together with the simulated view image. .

  Furthermore, when the reproduction part to be reproduced of the driving scenario detected by the reproduction part detection unit 15 is input, the viewpoint reproduction unit 16 determines the trainee's viewpoint position input from the reproduction part detection unit 15. You may output to the display part 40. FIG.

  Among the functional blocks of the railway simulator 10 described above, the function portion surrounded by the chain line in FIG. 1 can be represented as a simulator body 10a. As shown in FIG. 4, the simulator body 10 a includes a calculation unit 60, a storage unit 61, a display unit 62, an input unit 63, an output unit 64, and a communication unit 65.

  The calculation part 60 implement | achieves each function enclosed with the chain line of the railway simulator 10 mentioned above by running the predetermined | prescribed program memorize | stored in the memory | storage part 61. FIG.

  The simulator body 10a can be formed using, for example, one or a plurality of servers, or a computer such as a personal computer or a state machine. When the simulator body 10a is formed using a plurality of computers or the like, it is preferable to have means for synchronizing with each other.

  Moreover, you may form all the functions of the simulator main body 10a, or one part function using hardware, such as an electronic circuit.

  Next, an operation example of the above-described railway simulator 10 will be described below with reference to the drawings.

  First, the scenario reproducing unit 17 reproduces a simulated view image based on the driving scenario recorded in the scenario recording unit 20 and displays it on the display unit 40. The scenario playback unit 17 inputs operation information from the operation input unit 41 and changes the playback speed according to the operation of the trainee.

  As shown in FIG. 5, the driving scenario recorded in the scenario recording unit 20 has a data structure W <b> 1 including information on an object or the like on which a trainee performs a confirmation operation. The data structure W1 is associated with a simulated view image of the driving scenario.

  In the data structure W1, the distance, the object ID arranged at the distance, the object, and the state of the object are recorded in association with each other. Here, the unit of distance is km.

  Specifically, in the data structure W1, at the distance of 5 km, three display traffic lights with the object ID: T1 are arranged, and the state of this traffic light is blue. In addition, at a distance of 10 km, three indication traffic lights with the object ID: T2 are arranged, and the state of this traffic light is red. In addition, at a distance of 15 km, a call sign with an object ID: T3 is arranged. Further, at a distance of 20 km, a railroad crossing with the object ID: T4 is arranged, and the state of the railroad crossing is cut off. Furthermore, at a distance of 20 km, a vehicle with an object ID: T5 is arranged, and the state of this vehicle is within a railroad crossing.

  The evaluation unit 12 inputs the data structure W1 output by the scenario playback unit 17, and based on the distance between the position of the railway vehicle and the object, the position of the line of sight, the calling and pointing that are voices Evaluate the operation.

  The evaluation standard changing unit 14 changes the evaluation standard used by the evaluation unit 12 for each object or the like according to the traveling speed of the railway vehicle which is a simulated driving situation. The timing at which the evaluation criterion changing unit 14 changes the evaluation criterion can be a point in time when the distance between the object and the position of the railway vehicle becomes a predetermined distance. Here, it is preferable that the timing for changing the evaluation criterion is set so that the railway vehicle is located farther from the start distance than the object.

  Here, it is assumed that the traveling speed when the railway vehicle approaches the object ID: T1 arranged at a distance of 5 km is 80 km / h.

  For the three display traffic lights of the object ID: T1 arranged at a distance of 5 km, the start distance as an evaluation standard is changed to 0.6 km according to the traveling speed of the vehicle at 80 km / h. Therefore, the evaluation unit 12 starts the evaluation after the position of the railway vehicle approaches 4.4 km or less after approaching the start distance or less with respect to the three display traffic lights with the object ID: T1.

  The evaluation unit 12 performs the first evaluation when the position of the railway vehicle reaches a distance of 4.4 km, which is the start distance. The viewpoint position (x1, y1) on the trainee's display 40 a is input to the evaluation unit 12 from the viewpoint detection unit 30. The evaluation unit 12 receives the position (tx1, ty1) of the three display traffic lights with the object ID: T1 on the display 40a from the scenario reproduction unit 17. Here, the position (x1, y1) of the viewpoint and the position (tx1, ty1) of the three display signals are positions on the same coordinate system. Next, the evaluator 12 determines whether the distance between the viewpoint position (x1, y1) and the position of the three current traffic lights (tx1, ty1) is equal to or less than a predetermined threshold. Here, since the obtained distance is larger than the predetermined threshold value, it is not determined that the trainee correctly turned his / her line of sight to the object.

  The recording processing unit 13 records the evaluation result of the evaluation unit 12 in the training result recording unit 23. FIG. 6 shows a data structure W2 that is associated with the driving scenario recorded in the training result recording unit 23 and is evaluated by the evaluation unit 12. At a distance of 4.4 km, it is not determined that the trainee has correctly turned his / her line of sight to the object. Therefore, a flag L is recorded at the viewpoint position as the evaluation result flag.

  Next, the evaluation unit 12 determines the degree of coincidence between the character string that has been recognized by the voice recognition unit 31 and converted into a character string, and the reference character string recorded in the character string recording unit 22. The evaluation unit 12 reads a data structure W3 including a reference character string associated with an object or the like recorded by the trainee recording unit 22 and subjected to a confirmation operation. In the data structure W3, a distance, an object ID arranged at the distance, a calling ID for the object ID, and a reference character string for the calling ID are recorded in association with each other. Here, the unit of distance is km.

  The evaluation unit 12 has a degree of coincidence between the character string recognized by the voice recognition unit 31 and the reference character string “Daiichi Heisoku Shinko” of the calling ID associated with the object ID: T1 being equal to or higher than a predetermined degree of coincidence. Determine whether. Here, since the trainee has not made a call, since there is no input character string, it is not determined that the trainee has made a correct call. Also, since the trainee has not made a call, the volume of the call is not recorded.

  The recording processing unit 13 records the evaluation result of the evaluation unit 12 in the training result recording unit 23.

  Next, the evaluation unit 12 determines whether the detected movement amount of the hand and arm is larger than a predetermined threshold value. Here, since the trainee is not performing the pointing operation, it is not determined that the pointing operation has been performed.

  The evaluation unit 12 repeats the above-described evaluation for each predetermined distance until the position of the railway vehicle becomes equal to or less than the start distance and passes the position of the object. In the present embodiment, the evaluation unit 12 performs the evaluation every time the distance changes by 0.1 km. In this embodiment, the distance change amount is set to 0.1 km for the sake of explanation, but the distance change amount is not limited to 0.1 km. For example, the amount of change in distance may be made smaller than 0.1 km to perform a highly accurate evaluation.

  In the example shown in FIG. 6, in the evaluation at the time when the position of the railway vehicle becomes 4.6 km, the distance between the viewpoint position (x3, y3) and the position of the three current traffic lights (tx3, ty3) is Since it is below the predetermined threshold value, it is determined that the trainee correctly turned his / her line of sight to the object. In addition, the degree of coincidence between the character string recognized by the voice recognition unit 31 and the reference character string “Daiichi Heisoku Shinko” of the calling ID associated with the object ID: T1 is equal to or higher than the predetermined degree of coincidence. It is determined that the trainee made the correct call. Also, the volume of the trainee's call is recorded. Furthermore, since the movement amount of the hand and arm detected by the evaluation unit 12 is larger than a predetermined threshold value, it is determined that the trainee has performed a pointing operation. The evaluation unit 12 may evaluate the volume of the trainee's call.

  The recording processing unit 13 records the evaluation result of the evaluation unit 12 in the training result recording unit 23. In the data structure W2, the character string “Daiichi Heisokushinko” in which the calling is recognized at a distance of 4.6 km is recorded, the calling volume 40 is recorded, and the position of the viewpoint and the flag of the evaluation result are recorded. A flag H is recorded for calling and pointing.

  Since the trainee did not perform a further confirmation operation after performing the confirmation operation at a distance of 4.6 km, the evaluation result is recorded in the data structure W2.

  In the above description, since the trainee has performed the operation of directing his / her line of sight to the object, the calling and the pointing operation at the same timing, the evaluation unit 12 processes the evaluation of each confirmation operation at a distance of 4.6 km. Was. For example, when the trainee performs each confirmation operation at different timings, that is, when the trainer performs each confirmation operation at a different position with respect to the object or the like, the evaluation unit 12 Each check operation is evaluated at a different timing.

  If the trainer is performing each confirmation operation but not all the confirmation operations are performed within a predetermined time, that is, the trainer is trained within a predetermined distance from the object or the like. However, when each confirmation operation is not performed, the evaluation unit 12 may determine that the trainee did not correctly perform each confirmation operation.

  Next, the evaluation criterion changing unit 14 uses the evaluation unit 12 to evaluate the next object ID: T2 arranged at a distance of 10.0 km according to the traveling speed of the railway vehicle that is a simulated driving situation. Change the criteria.

  Here, it is assumed that the traveling speed when the railway vehicle approaches the object ID: T2 arranged at a distance of 10.0 km is 45 km / h.

  For the three display traffic signals with the object ID: T2 arranged at the position of the distance 10.0 km, the start distance as the evaluation standard is changed to 0.4 km according to the vehicle speed 45 km. Therefore, the evaluation unit 12 starts the evaluation after the position of the railway vehicle has approached the start distance or less with respect to the three indication traffic signal of the object ID: T2, specifically, after becoming 9.6 km.

  The evaluation unit 12 repeats the above-described evaluation for each predetermined distance until the position of the railway vehicle becomes equal to or less than the start distance and passes the position of the object. Specifically, the evaluation unit 12 performs the evaluation every time the distance changes by 0.1 km.

  In the example shown in FIG. 6, in the evaluation when the position of the railway vehicle reaches a distance of 10.0 km, the movement amount of the hand and arm detected by the evaluation unit 12 is larger than a predetermined threshold value. It is determined that a differential operation has been performed. In addition, since the distance between the viewpoint position (x5, y5) on the display 40a and the position (tx5, ty5) of the three display traffic lights is equal to or less than a predetermined threshold, the trainer correctly It is determined that his eyes are directed. However, the degree of coincidence between the character string recognized by the speech recognition unit 31 and the reference character string “Dai Nisokushinko” of the calling ID associated with the object ID: T2 is lower than the predetermined degree of coincidence. The trainer is not judged to have made the correct call. Here, when the voice recognizing unit 31 recognizes the voice spoken by the trainee, the character string recognized by the voice recognizing unit 31 and the volume of the call are recorded. In the example shown in FIG. Since he did not speak, it was not recorded together.

  The recording processing unit 13 records the evaluation result of the evaluation unit 12 in the training result recording unit 23. In the data structure W2, at a distance of 10.0 km, as an evaluation result flag, a flag H is recorded for a finger point and a viewpoint position, and a flag L is recorded for a call. Since the call is not recognized, the character string and call volume are not recorded.

  Further, the railway simulator 10 continues to simulate the simulated driving based on the driving scenario, and continues to evaluate the confirmation operation of the trainee for the object IDs T3 to T5 recorded in the data structure W1.

  In the operation example of the railway simulator 10 described above, the evaluation reference changing unit 14 changes the evaluation reference for the confirmation operation based on the travel speed of the railway vehicle and the distance between the position of the railway vehicle and the traffic signal that is the object. You may do it. In this specification, the simulated driving situation includes the distance between the position of the railway vehicle and the traffic signal that is the object.

  The moving speed of the traffic signal displayed on the display 40a is slow when the distance between the position of the railway vehicle and the traffic signal that is the object is long, and the distance between the position of the railway vehicle and the traffic signal that is the object. It gets faster when is near. This is because the scenario reproducing unit 17 draws a simulated visual field image of the traffic signal based on the distance between the position of the railway vehicle and the traffic signal that is the object. It is conceivable that the margin when the trainee performs the confirmation operation on the traffic light differs depending on the moving speed of the traffic light displayed on the display 40a. Therefore, by changing the evaluation criteria for the confirmation operation for the traffic light based on the moving speed of the traffic signal displayed on the display 40a, the evaluation criteria for the confirmation operation according to the margin when the trainee performs the confirmation operation. Is to change.

  Next, an operation example of the reproduction location detection unit 15 of the railway simulator 10 will be described below with reference to the drawings.

  As a result of the simulated operation of the railway simulator 10 described above, the training result recording unit 23 records the data structure W2 shown in FIG.

  The reproduction location detection unit 15 detects, for each trainer, a reproduction location to be reproduced in the driving scenario based on the trainee ID and the evaluation result recorded in the training result recording unit 23. The reproduction location detection unit 15 is a trainee regarding the pointing operation detected by the evaluation unit 12, the character string that the speech recognition unit 31 recognizes the voice and converted into a character string, or the viewpoint position detected by the viewpoint detection unit 30. Detects a driving scenario of a part such as an object that has not been evaluated as having performed the correct operation.

  The reproduction location detection unit 15 examines the flag of the evaluation result for each object ID between steps S10 to S16 in FIG.

  Specifically, first, the processes of steps S12 and S14 are performed for the object ID: T1.

  In step S <b> 12, the reproduction location detection unit 15 checks the flag of the evaluation result of the position of the viewpoint, the calling and the pointing, and checks the presence or absence of the flag H. In the data structure W2 illustrated in FIG. 6, the flag H is recorded at a distance of 4.6 km for each of the viewpoint position, the call, and the finger point.

  Next, in step S14, if there is no flag H in any of the evaluation results of the line-of-sight position, the calling, and the pointing, it is determined that the object ID is to be reproduced. As a result of the examination in step S12, the flag H is included in the evaluation results of the line-of-sight position, the calling, and the finger pointing, so the reproduction point detection unit 15 is an object that has not been evaluated that the trainer has performed the correct action. Evaluate that there are no parts.

  Therefore, the reproduction part detection unit 15 does not detect the reproduction part to be reproduced in the driving scenario for the object ID: T1.

  Next, the process of step S12 and S14 is performed with respect to target object ID: T2.

  First, in step S <b> 12, the reproduction point detection unit 15 checks the flag of the evaluation result of the position of the viewpoint, the calling and the pointing, and checks the presence or absence of the flag H. A flag H is recorded at a distance of 10.0 km for the evaluation results of the viewpoint position and the finger difference. However, the flag H is not recorded for the evaluation result of the call.

  Next, in step S14, if the flag H is not present in any of the evaluation results of the line-of-sight position, the calling, and the pointing, it is determined that the object ID is a reproduction portion to be reproduced. As a result of the examination in step S12, since the evaluation result for the call does not include the flag H, the reproduction location detection unit 15 determines that this is the reproduction location where the object ID: T2 is to be reproduced.

  Therefore, the reproduction part detection unit 15 outputs the object ID: T2 that is the reproduction part to be reproduced of the detected driving scenario to the scenario reproduction unit 17 and the viewpoint reproduction unit 16.

  Similarly, the remaining object IDs are continuously evaluated.

  The scenario reproducing unit 17 that has input the object ID: T2, which is the reproduction part to be reproduced of the driving scenario, from the reproduction part detecting unit 15 outputs the simulated view image associated with the object ID: T2 to the display unit 40. To do. The viewpoint playback unit 16 inputs the data structure W2 recorded in the training result recording unit 23 via the playback location detection unit 15, and stores the recorded viewpoint position and the recognized voice character string. Output to the display unit 40. The display unit 40 displays the input viewpoint position and the recognized character string of the voice on the display 40a together with the simulated view image.

  The trainee can grasp the error in the confirmation operation by watching the video of the training he / she performed on the display 40a. In addition, the trainer may perform a simulated operation again using the portion of the driving scenario to be replayed so that the confirmation operation can be performed correctly.

  Next, another operation example of the railway simulator 10 will be described below.

  The railway simulator 10 can also change the object when the position of the trainee's viewpoint is a predetermined distance or more away from the object to which the line of sight is directed.

  Further, an operation example of the railway simulator 10 will be described below with reference to FIG.

  First, in step S30, the evaluation unit 12 determines that the viewpoint position on the trainer's display 40a is based on the trainee's ID and the data structure W2 that is the evaluation result recorded in the training result recording unit 23. Measure the time away from the traffic light to which the

  Next, in step S <b> 32, the evaluation unit 12 changes the display of the traffic signal to the scenario reproduction unit 17 when the measured time has passed a predetermined time. The scenario reproducing unit 17 changes the traffic signal display from blue to red or yellow.

  In W2 of the data structure, in the confirmation operation of the traffic light with the object ID: T2, the trainee performs a further confirmation operation until the vehicle passes the position of the object after performing the confirmation operation at a distance of 4.6 km. Absent. Therefore, the position of the viewpoint continues to be away from the traffic light to which the line of sight is directed by a predetermined distance or more.

  According to the present embodiment, in such a case, it is possible to perform a training to change the display of the traffic light so that the trainee always pays attention to the traffic light.

  Normally, when driving a car, the driver always pays attention to the traffic light. On the other hand, in the case of a driver driving a railway vehicle traveling on a track, the confirmation operation for directing the line of sight to the traffic light is directed at the traffic light at the same time as pointing and calling, but the pointing and calling After doing, you may neglect to turn your eyes. Therefore, with the above-described configuration, the railway simulator 10 can train the trainer to pay attention to the traffic light at all times, and reliably learn the confirmation operation.

  According to the above-described railway simulator 10 of the present embodiment, the evaluation standard for the confirmation operation performed by the trainer who trains the simulated operation of the railway is changed according to the simulated operation status of the railway vehicle. The confirmation operation performed by the trainer can be evaluated according to the margin when performing.

  In the present invention, the railway simulator and the simulation method of the above-described embodiment can be appropriately changed without departing from the gist of the present invention.

  For example, in the above-described embodiment, the pointing operation performed by the trainee, the position of the viewpoint, and the speech spoken by the trainee are detected or recognized and evaluated, but at least one of these confirmations is confirmed. Any device that evaluates the operation may be used. Moreover, you may make it evaluate other pointing operation | movement and the position of a viewpoint performed by a trainee, and other confirmation operation | movement of the voice which a trainee speaks.

  In addition, the state where the trainee is performing the simulated driving may be captured by a video camera and recorded in the training result recording unit. Then, when the playback location detection unit detects a playback location to be played back of the driving scenario, the video of the captured video camera may be played back and displayed together with the playback of the driving scenario.

DESCRIPTION OF SYMBOLS 10 Railroad simulator 10a Simulator main body 11 Initialization part 12 Evaluation part 13 Recording process part 14 Evaluation criteria change part 15 Reproduction | regeneration location detection part 16 View point reproduction part 17 Scenario reproduction part 20 Scenario recording part 21 Initialization value recording part 22 Character string recording part DESCRIPTION OF SYMBOLS 23 Training result recording part 30 Viewpoint detection part 31 Voice recognition part 31a Voice input part 31b Character string conversion part 32 Stereo image pick-up part 40 Display part 40a Display 40b Orbit 40c 3 Display signal 41 Operation input part 42 ID input part 50 Instrument panel 50a Speedometer 51 Operation panel 52 Master controller 54 Seat P Trainer F Voice 60 Calculation unit 61 Storage unit 62 Display unit 63 Input unit 64 Output unit 65 Communication unit

Claims (12)

A railway simulator that simulates simulated driving of a railway vehicle based on a driving scenario,
An imaging unit that images the trainee, a voice input unit that inputs voice, or a viewpoint detection unit that detects the position of the viewpoint;
The trainee's pointing operation detected based on the image captured by the imaging unit, the character string converted by recognizing the voice input by the voice input unit, or the position of the viewpoint detected by the viewpoint detection unit An evaluation unit that evaluates based on evaluation criteria;
An evaluation standard changing unit that changes the evaluation standard according to the simulated driving situation of the railway vehicle,
Railway simulator with The simulated driving situation is the speed of the railway vehicle,
The railway simulator according to claim 1, wherein the evaluation standard changing unit changes the evaluation standard according to a speed of the railway vehicle. The evaluation criterion is a starting distance that is a distance between the position of the railway vehicle where the evaluation unit starts the evaluation and a trainee's pointing operation, or an object to which a voice or line of sight is directed,
The evaluation standard changing unit changes the start distance according to the speed of the railway vehicle,
The railway simulator according to claim 2, wherein the evaluation unit starts the evaluation after the position of the railway vehicle approaches the start distance or less with respect to the object.   The railway simulator according to any one of claims 1 to 3, wherein the evaluation criterion is a movement amount for determining the presence or absence of a pointing operation.   The railroad simulator according to any one of claims 1 to 3, wherein the evaluation criterion is a degree of coincidence between a character string converted by recognizing an input voice and a reference character string.   The railway simulator according to any one of claims 1 to 3, wherein the evaluation criterion is a distance between a viewpoint position and an object to which a trainee's line of sight is directed. The evaluation unit records the detected pointing operation, the character string converted by recognizing the input voice, or the result of evaluating the viewpoint position detected by the viewpoint detection unit based on the evaluation criterion. A training result recording section;
Based on the evaluation result recorded in the training result recording unit, a reproduction point detection unit that detects a reproduction point to be reproduced in the driving scenario,
A railway simulator according to any one of claims 1 to 6. A scenario recording section for recording driving scenarios;
A scenario playback unit for playing back a scenario video based on the driving scenario recorded in the scenario recording unit;
With
The railroad simulator according to claim 7, wherein the reproduction part detection unit causes the scenario reproduction unit to reproduce the reproduction part of the detected driving scenario. An initialization unit that initializes the imaging unit, the voice input unit, or the viewpoint detection unit in correspondence with a trainee;
An initialization value recording unit that records the initialization value obtained by initializing the imaging unit, the voice input unit, or the viewpoint detection unit in association with the identification information of the trainer;
A railway simulator according to any one of claims 1 to 8.   The position of a trainee's viewpoint changes a target object when predetermined time passes in the state away from the target object for which a trainee's gaze is directed more than a predetermined distance. Railway simulator described in 1.   The railway simulator according to claim 10, wherein the object to which the trainee's line of sight is directed is a traffic light. A method for simulating a rail car based on a driving scenario,
Detect the trainee's pointing action based on the image of the trainee, or detect the position of the viewpoint using the viewpoint detector, or input the voice that the trainee speaks using the voice input section As a string,
A method in which a computer executes evaluation of a detected pointing action or a position of a viewpoint or a recognized character string based on an evaluation criterion that is changed according to a simulated driving situation of a railway vehicle.

Images