WO2024106090A1

WO2024106090A1 - Data display device, data display method, and railway business system

Info

Publication number: WO2024106090A1
Application number: PCT/JP2023/037078
Authority: WO
Inventors: 祐紀子木下
Original assignee: 株式会社日立製作所
Priority date: 2022-11-18
Filing date: 2023-10-12
Publication date: 2024-05-23
Also published as: JP2024073739A

Abstract

This data display device displays a plurality of sets of railway information collectively on a virtual space by using a computer having a processor and a memory. The processor: acquires a plurality of sets of railway information from a railway business system and stores the railway information in the memory; acquires, from a user terminal, information relating to avatar operation which is performed in a virtual space by a user and stores the information in the memory; combines visualization methods for the plurality of sets of railway information that have been stored and determines a data display position in multiple dimensions in the virtual space by using the stored information relating to the avatar operation by the user and railway business system dynamic information; and depicts a virtual-space display state created on the basis of the determined data display positions.

Description

Data display device, data display method, and railway operations system

The present technology relates to a data display device, a data display method, and a railway operations system.

Regarding information necessary for railway operations, Patent Document 1 discloses a device that displays data related to users for each combination of departure and destination in a transportation network in a three-dimensional virtual space. Patent Document 1 states that "in a virtual three-dimensional space, a first layer in which at least one of the points constituting the transportation network is arranged, and a second layer in which all or some of the identifiers of each point are arranged are arranged at a given interval. Then, for each combination in which a point corresponding to an identifier in the first layer is a departure point and a point corresponding to an identifier in the second layer is a destination point, an indication line connecting the identifier of the departure point and the identifier of the destination point is drawn in a form based on data related to the number of users corresponding to the combination." Patent Document 2 discloses a device that displays the degree of train congestion by coloring trains on a timetable diagram. Patent Document 2 states that "The creation unit 26 creates a train timetable in which train lines are displayed in different colors, different line types, and different thicknesses depending on the passenger occupancy rate of the target section, and creates display data for the train timetable displayed with train lines that visually change depending on the passenger occupancy rate."

JP 2015-20650 A JP 2006-327239 A

Patent Document 1 is a display method that encourages intuitive understanding, but it can only display one type of information: users' arrival and departure information. Patent Document 2 displays two types of information, train operation information and congestion level, on one chart, but on a congested train schedule, it is difficult to see the difference in color, and it is not possible to see the difference in congestion level between trains classified as the same color, making it difficult to extract necessary information, such as which trains are particularly crowded. For this reason, in order for dispatchers to understand the operation status, they need to obtain the necessary information from charts on multiple displays whose display content is constantly changing, and match the information, so the effect of reducing the burden of understanding the situation in dispatcher work is limited. Furthermore, when displaying information on a display, the operating device and the display screen are not integrated, making it difficult to operate intuitively.

The present invention aims to seamlessly display multiple pieces of railway information, which are difficult to display in their entirety on a two-dimensional surface, through intuitive operations by the dispatcher.

The data display device of the present invention is a data display device that uses a computer having a processor and memory to display multiple pieces of railway information together in a virtual space, and the processor is configured as a data display device characterized in that it acquires the multiple pieces of railway information and stores them in the memory, acquires user avatar operation information performed in the virtual space and stores it in the memory, combines the stored visualization methods for the multiple pieces of railway information, determines the data display position in multiple dimensions of the virtual space based on the stored user avatar operation information and railway business system dynamic information, and draws the created virtual space display state based on the determined data display position.

The present invention makes it possible to seamlessly display multiple pieces of railway information, which are difficult to display in their entirety on a two-dimensional surface, through intuitive operations by the dispatcher.

1 is an example of a network configuration of a data display system and related systems. 1 is an example of a hardware configuration of a data display system. 2 is an overall flowchart of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is a flowchart of a virtual space data construction unit of the data display system. 1 is an example of a data structure of a visualization frame of a data display system. 13 is an example of a data structure of a visualization frame after information is reflected in the data display system. 1 is an example of a diagram visualization frame of a data display system. 1 is an example of a track number information visualization frame of a data display system. 1 is an example of a data structure of virtual space structure data of a data display system. 13 is a flowchart of a virtual space display data generating unit of the data display system. 13 is an example of a data structure of an avatar operation log of the data display system. 1 is a diagram illustrating an example of a data structure of a virtual space display state of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system. 13 is an example of a display output in a virtual space of the data display system.

Below, an embodiment of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and some parts have been omitted or simplified as appropriate for clarity of explanation. The present invention can also be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

The position, size, shape, range, etc. of each component shown in the drawings may not represent the actual position, size, shape, range, etc., in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the position, size, shape, range, etc. disclosed in the drawings.

In the following explanation, various types of information may be explained using expressions such as "database," "table," and "list," but the various types of information may be expressed in data structures other than these. To indicate independence from data structure, "XX table," "XX list," and the like may be referred to as "XX information." When explaining identification information, when expressions such as "identification information," "identifier," "name," "ID," and "number" are used, these are interchangeable.

When there are multiple components with the same or similar functions, they may be described using the same reference numeral with different subscripts. However, when there is no need to distinguish between these multiple components, the subscripts may be omitted.

In addition, in the following description, the processing performed by executing a program may be described, but the program is executed by a processor (e.g., a CPU or a GPU (Graphics Processing Unit)) to perform a specified process using storage resources (e.g., memory) and/or interface devices (e.g., communication ports) as appropriate, so the subject of the processing may be the processor. Similarly, the subject of the processing performed by executing a program may be a controller, device, system, computer, or node having a processor. The subject of the processing performed by executing a program may be a calculation unit, and may include a dedicated circuit that performs specific processing (e.g., an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit)).

The program may be installed in a device such as a computer from a program source. The program source may be, for example, a program distribution server or a computer-readable storage medium. When the program source is a program distribution server, the program distribution server may include a processor and storage resources for storing the program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. Also, in the following description, two or more programs may be realized as one program, and one program may be realized as two or more programs.

FIG. 1 shows a block diagram of the data display system 100 of this embodiment and related systems connected to the data display system 100.

The data display system 100 comprises a railway operation system information acquisition unit 101, an avatar operation information acquisition unit 102, a virtual space data construction unit 103, a virtual space display data creation unit 104, and a display result output unit 105. The railway operation system information acquisition unit 101 stores railway operation system static information 111 and railway operation system dynamic information 115, and the avatar operation information acquisition unit 102 stores an avatar operation log 116. The virtual space data construction unit 103 uses the visualization frame 112 to create and store a post-information reflection visualization frame 113 and virtual space structure data 114. The virtual space display data creation unit 104 uses the post-information reflection visualization frame 113 and the virtual space structure data 114 to create and store virtual space display state data 117.

The data display system 100 is connected to the railway operations system 200 via the communication network N1. These are systems that distribute data required by the data display system 100. The railway operations system 200 refers to all systems required for railway operations, and examples include the operation control system 201, the vehicle management system 202, and the people flow information system 203. The operation control system 201 is a system that manages train operations, such as that disclosed in JP 2005-138710 A. The operation control system 201 manages information such as train positions, station surveillance cameras, and railroad crossings that can be obtained from the railway's ground system. The vehicle management system 202 is a system that manages railway vehicles, such as that disclosed in JP 2022-536059 A. The vehicle management system 200 manages information such as speed, load weight, and vehicle cameras that can be obtained from the railway's vehicle system. The people flow information system 203 is a system that manages information related to railway users, such as those described in JP 2002-187551 A and JP 2014-206829 A. The people flow information system 203 manages information related to railway users, such as probe data, ticket gate data, SNS data, and route search results.

The data display system 100 is also connected to the user terminal 300 via the communication network N2, transmits information to be displayed on the output screen of the user terminal 300, and acquires operation information of the user terminal 300. The user terminal 300 displays a virtual space and operates an avatar in the virtual space. Here, the virtual space refers to a space virtually constructed by digital technology. In particular, the virtual space is not flat but is mainly a three-dimensional space with depth. Also, the avatar refers to an agent that moves around in the virtual space and is operated by the user. The avatar reproduces the user's operation and characteristic parts and movements in the virtual space, for example, the parts and movements of the user's arms, hands, and fingers. The output device of the user terminal 300 may be a device that blocks the field of view with a display, such as a head-mounted display, or a device that displays the field of view directly to the brain, such as a BMI (brain-machine interface). The input device of the user terminal 300 operates the avatar and may be a controller, a sensor that recognizes the user's hand gestures, or a BMI that acquires brain information. The user terminal 300 is managed, for example, by a transportation company that operates a specific transportation facility, and is used by a system user who uses the data display system 100, such as a dispatcher of the transportation company. The communication networks N1 and N2 may be a common network, or may be networks that use different protocols.

FIG. 2 shows an example of the hardware configuration of the data display system 100. The data display system 100 is composed of devices capable of various types of information processing, for example, an information processing device such as a computer. The data display system 100 has a storage device 500, a memory 510, a calculation device such as a CPU (hereinafter simply referred to as the CPU) 511, a UI device 512, and a communication device 513.

The storage device 500 is a non-volatile storage device such as an SSD or a hard disk drive, and stores data such as programs that implement the units 101-105 (see Figure 1), which are functional modules executed by the data display system 100, as well as data required to execute the functional modules or data 111-117 (see Figure 1) generated by the functional modules.

The memory 510 is a volatile memory such as a RAM. When the data display system 100 starts operating (for example, when the power is turned on), the CPU 511 reads the above program from the storage device 500, and develops and executes it on the memory 510. The UI device 512 is connected to input devices such as a keyboard, mouse, and controller, not shown, and output devices such as a display, and realizes a GUI. The communication device 513 performs communication processing with external related systems via the networks N1 and N2.

The operation management system 201, vehicle management system 202, people flow information system 203, and user terminal 300 shown in FIG. 1 also have the same hardware configuration as the data display system 100.

FIG. 3 shows the overall processing flow of the above-mentioned functional modules of the data display system 100. This processing starts when a start instruction is received from the user terminal 300.

First, the railway operation system information acquisition unit 191 of the data display system 100 acquires the railway operation system static information 111 (S301). Next, the virtual space data construction unit 103 of the data display system 100 uses the acquired railway operation system static information 111 and a pre-stored visualization frame 112 to construct a post-information reflection visualization frame 113 and virtual space structure data 114 (S302). Note that the visualization frame 112 stores a display method that reads out and utilizes the three-dimensional space of the virtual space. This allows the data display system 100 to prepare the railway information and visualization method to be displayed in advance.

The data display system 100 repeats steps S304 to S307. This process is repeated at a timing (for example, every second) that is determined in advance by the data display system 100. First, the avatar operation information acquisition unit 102 of the data display system 100 acquires avatar operation information from the user terminal 300, i.e., information obtained from the input device of the user terminal 300 (S304). Avatar operation refers to touching each element in the virtual space, moving each element, moving the position of the avatar in the virtual space, changing the line of sight in the virtual space, and the like. At this time, the avatar operation is accumulated in the avatar operation log 116. Note that when no avatar operation is being performed, this step is skipped. The railway operation system information acquisition unit 101 of the data display system 100 acquires railway operation system dynamic information 115 (S305). The virtual space display data creation unit 104 of the data display system 100 creates and updates the virtual space display state data 117 using the acquired latest avatar operation information, the railway operation system dynamic information 115, and the virtual space structure data 114 (S306). This allows the data display system 100 to select the railway information and the visualization frame after information reflection that are actually displayed from the prepared virtual space structure data 114 and the visualization frame after information reflection 113, and to create data that reads out and utilizes the three-dimensional space to display the information.

The display result output unit 105 of the data display system 100 outputs the virtual space display state data 117 and transmits it to the user terminal 300 (S307). This enables the data display system 100 to display the created display data.

As described above, the data display system 100 prepares the railway information to be displayed and the visualization method in advance, and determines which railway information to actually display from among multiple pieces of railway information and the display method using avatar operation information such as touching each element in the virtual space, moving each element, moving the position of the avatar in the virtual space, and changing the line of sight in the virtual space, as well as dynamic information from the railway business system, and is able to display multiple pieces of railway information in multiple dimensions.

In Example 2, the details of each functional module in the processing flow of the data display system 100 will be explained, taking as an example the case in Example 1 where railway information is displayed using a train operation management chart (timetable chart) as the base chart. Hereinafter, the timetable that serves as the base chart will be referred to as the main timetable.

Before going into the detailed explanation of each functional module and data, we will use Figures 4 and 5 to explain an example of the display output in the virtual space that will be explained in this embodiment.

The data display system 100 displays a combination of the line L1 displayed on the main diagram and the timetable of the comparison line L2 that runs parallel to the main diagram but has the same departure and arrival stations, as shown in FIG. 4. When the line L1 displayed on the main diagram runs through stations A, B, C, and D, and the comparison line L2 runs through stations A, E, F, and D, the data display system 100 (the display result output unit 105) outputs data to display the main diagram on a plane. As described below, when a user grasps the main diagram with both hands via an avatar and pulls it, the virtual space display data creation unit 104 of the data display system 100 generates a curved surface that intersects with the plane of the main diagram on a straight line indicating stations A and D and is uneven in a direction perpendicular to the plane, and creates data to display the timetable of the comparison line on this curved surface. The curved surface is generated so that the travel distance, travel time, and length between each station match. Line T1 is an example of a train that runs on line L1, and line T2 is an example of a train that runs on line L2. From now on, this example will be called the multiple timetable display example. A line may also include a vehicle depot.

The data display system 100 displays, for example, as shown in FIG. 5, a combination of line L1 displayed on the main diagram and track number information (simplified wiring diagram) of a certain station on the main diagram. When line L1 displayed on the main diagram runs through stations A, B, C, and D, the data display system 100 (the display result output unit 105) outputs data to display the main diagram on a plane. As will be described later, when a user performs an operation to grab and pull a train stopped at station C via an avatar, if there are platforms C1, C2, and C3 at station C, the virtual space display data creation unit 104 creates data to display platforms C1, C2, and C3 parallel to the axis of station C in the third axis direction from the station on the main diagram, and to move trains on the main diagram that run on each platform during the time periods before and after the relevant train onto the platforms. Hereafter, this example will be referred to as a track number information display example.

In this way, the data display system 100 uses multiple dimensions to display multiple pieces of railway information only in the necessary areas operated by the user, allowing the user to intuitively and seamlessly view the information they want. The configuration for achieving the displays shown in Figures 4 and 5 is described below.

FIG. 6 shows the processing flow of the virtual space data construction unit 103, which is a functional module of the data display system 100. The virtual space data construction unit 103 uses the visualization frame 112 to generate a timetable frame for the target line (S601).

FIG. 7 is an example of the data structure of a visualization frame 112 stored in the data display system 100. The visualization frame indicates the data visualization rules for displaying data. In the data display system 100, the virtual space data construction unit 103 and the virtual space display data creation unit 104 combine the visualization frame 112 with data required by the visualization frame 112 from the railway operation system static information 111 and the railway operation system dynamic information 115 to generate a visualization frame after information reflection 113, which is used in the creation of the visualization frame after information reflection 113 by the virtual space display data creation unit 104. The visualization frames stored in the data display system 100 are designed and stored in advance in accordance with the command operations of the railway operator, with regard to the necessary input data and data visualization rules.

As shown in FIG. 7, the visualization frame has a frame ID 701 area, a display link 702 area, a display operation 703 area, and a template 704 area. The frame ID 701 area stores a name or identification code that identifies the frame. The display link 702 area stores the element that is the starting point for displaying the visualization frame, among the main diagram diagram divided into the overall diagram network, train network, station axis, time cross section axis, edge, and node elements. There are two types of storage methods for the display link, From and To. When the visualization frame is displayed starting from the main diagram diagram, the element is stored as From, and when the main diagram diagram is displayed starting from the visualization frame, the element is stored as To. The display operation 703 area stores the user operation that is the trigger for displaying the visualization frame. The template 704 area stores a description of the visualization rules for the required data.

As an example of a template, template ID "Tmp001" is shown. The template has an object ID 705 area, an object name 706 area, an object type 707 area, a parent object 708 area, and a reference object 709 area. The object ID 705 area stores an identification code that specifies the object required by this template. The object name 706 area stores the name of the object required by this template. The object type 707 area stores the display type of each object. The parent object 708 area stores the object ID of the parent object when each object is to have a parent-child relationship with another object. The reference object 709 area stores the object ID of the referenced object when each object is to have a reference relationship with another object.

When data is stored in the visualization frame 112 according to the template, the method of visualizing the data is determined based on visualization rules according to the relationships between parent objects and reference objects indicated in the template. Note that visualization rules refer to source code that performs operations in virtual space, such as predetermined movement and rotation, on objects entered based on the template, and are stored in the visualization frame as part of the template. Figure 7 shows an example of the data structure of the visualization frame before reflecting the railway operation system static information 111 and railway operation system dynamic information 115. Although the display links, display operations, and templates are determined in advance, no actual values are stored, so temporary data is stored.

Figure 8 shows an example of the data structure of the visualization frame 113 after reflecting the railway operation system static information 111 and the railway operation system dynamic information 115. The visualization frame 113 after reflecting the information has a frame ID 801 area, a display link 802 area, a display operation 803 area, and a template 804 area, and within the template has an object ID 805 area, an object name 806 area, an object type 807 area, a parent object 808 area, and a reference object 809 area. All of these areas are equivalent to the visualization frame 112. Unlike the visualization frame 112, the visualization frame 113 after reflecting the information stores specific data such as a display link, the object ID within the template, and the object name.

By using this visualization frame 112, the data display system 100 can display the necessary railway information in a visualization method that matches the appropriate operation.

An example of the visualization frame 112 will be described with reference to Figs. 9 and 10. Fig. 9 is a visualization frame (diagram visualization frame) for the multiple diagram display example shown in Fig. 4. The template stores the visualization rules for the diagram, the display link stores the station axis as From, and the display operation stores "grab the entire diagram and pull it (main diagram is always displayed)". As a result, when the user grabs and pulls the entire main diagram, the data display system 100 can display the diagram of the comparison line starting from the station axis of the main diagram. In addition, by reflecting station arrangement information as static information of the railway business system and operation management information as dynamic information of the railway business system in the visualization frame and creating a visualization frame after reflecting the information, the data display system 100 can display the actual diagram in real time.

FIG. 10 is a visualization frame (schematic wiring diagram) of the example of the platform information display shown in FIG. 5. The template stores the visualization rules for the platform (schematic wiring diagram), and the display links store edges as From and train networks as To. The display operation stores "grab and pull a train stopped at a certain station." This allows the data display system 100 to display platform information (schematic wiring diagram) starting from the edge of the train being operated when the user grabs and pulls a train stopped at a certain station on the main diagram. In addition, by reflecting station arrangement information as static information of the railway business system and operation management information as dynamic information of the railway business system in the visualization frame and creating a visualization frame after reflecting the information, the data display system 100 can display the train network before and after the train being operated on the platform information (schematic wiring diagram).

Returning to FIG. 6, next, the virtual space data construction unit 103 generates virtual space structure data reflecting the values of the main diagram (S602). Details will be described later. The virtual space data construction unit 103 repeats steps S604 to S609 depending on the number of visualization frames to be displayed. The virtual space data construction unit 103 generates visualization frames to be displayed (S603). For example, as described above, it generates a diagram visualization frame and a track information visualization frame.

The virtual space data construction unit 103 repeats steps S604 to S609 for each piece of usage data in the visualization frame. If the usage data is static data (S604; YES), the virtual space data construction unit 103 reads out the railway operation system static information 111 (S605) and reflects the read value in the generated visualization frame (S606). Next, the virtual space data construction unit 103 outputs and updates the information-reflecting visualization frame 112 (S607). When static data is used, a visualization frame reflecting the value is output, but when static data is not used, the same visualization frame 112 is output, with no value reflected.

Next, the virtual space data construction unit 103 acquires elements having display link information of the visualization frame 113 after information reflection from the elements of the main diagram (S608). For example, as described above, in the multiple diagram display example, when looking at the display link information of the visualization frame reflecting information, a station axis that matches the station information of the comparison line is required. Therefore, the virtual space data construction unit 103 acquires a station axis that matches the station information of the comparison line from the main diagram. In the platform information display example, when looking at the display link information of the visualization frame reflecting information, an edge that matches the target station and a train network that matches the target platform are required. Therefore, the virtual space data construction unit 103 acquires the corresponding edge and train network from the main diagram. Note that at this point, avatar operation has not been performed and the target station and target platform have not been determined, so edges and train networks for all stations and platforms that can be the target station and target platform are acquired. The virtual space data construction unit 103 assigns visualization frame reference information to the acquired elements (S609). Details will be described later.

After completing all processing, the virtual space data construction unit 103 outputs the virtual space structure data 114 (S610).

FIG. 11 shows an example of the data structure of virtual space structure data 114. The virtual space structure data 114 has an object ID 1101 field, an object name 1102 field, an object type 1103 field, a parent object 1104 field, a reference object 1105 field, detailed information 1106 field, and a reference frame 1107 field. The virtual space structure data 114 also holds detailed information that is not stored in the visualization frame.

The object ID 1101 area, object name 1102 area, object type 1103 area, parent object 1104 area, and reference object 1105 area store values similar to those in the object ID 705 area, object name 706 area, object type 707 area, parent object 708 area, and reference object 709 area of the visualization frame 112. The detailed information 1106 area stores detailed information of the railway operation system static information 111 and the railway operation system dynamic information 115 according to the object. For example, for a ball (node) where a train departs from a station, the departure time and departure platform are stored. This allows the virtual space structure data 114 to hold various information required for various visualization frames based on the train schedule visualization frame. The reference frame 1107 area stores the frame ID of the visualization frame that can be displayed from each element (object) of the train schedule visualization frame, the display link, and the target information of the visualization frame. These values are stored through steps S604 to S609.

By carrying out the above steps S601 to S610, the virtual space data construction unit 103 can create the virtual space structure data required to change the display data by operating the avatar.

FIG. 12 shows the processing flow of the virtual space display data creation unit 104. The virtual space display data creation unit 104 receives avatar operation information from the avatar operation information acquisition unit 102, and stores it in the avatar operation log 116 (S1201).

Figure 13 shows an example of the data structure of avatar operation log 116. Avatar operation log 116 has a user ID 1301 area, a time 1302 area, an operation target 1303 area, an operation content 1304 area, and an operation auxiliary information 1305 area. The user ID 1301 area stores a name or identification code that identifies the user. The time 1302 area stores the time when the operation was performed. The operation target 1303 area stores the object ID and object name of the target object on which the operation was performed. The object ID and object name store data similar to that stored in the object ID 1101 area and object name 1101 area of virtual space structure data 114. The operation content 1304 area stores the operation performed by the avatar, such as "grab and pull", "grab with both hands and pull", and "move". The stored values are categorizations of the avatar's movements; the user terminal 300 may distribute data that classifies the avatar's movements into operation categories and the avatar operation information acquisition unit 102 may acquire these operation categories, or the user terminal 300 may distribute the user's movements and the avatar operation information acquisition unit 102 may acquire and classify them into operation categories based on the avatar's movements. The operation assistance information 1305 area stores assistance information when required by the operation category indicated in the operation content 1304 area. For example, if the operation content is "grab and pull", the length of the pull is stored as the operation assistance information, and if the operation content is "move", the coordinates of the destination are stored as the operation assistance information.

Returning to FIG. 12, the virtual space display data creation unit 104 reads the current virtual space display state from the virtual space display state data 117 (S1202).

FIG. 14 shows an example of the data structure of virtual space display state data 117. Virtual space state data 117 stores virtual space structure data and information for actually displaying the visualization frame after information reflection. Virtual space display state data 117 consists of an object ID 1401 area, an object name 1402 area, a parent object 1403 area, a local coordinate 1404 area, a world coordinate 1405 area, a local direction 1406 area, and a world direction 1407 area.

The object ID 1401 area, object name 1402 area, and parent object 1403 area store the same data as the object ID 1101 area, object name 1102 area, and parent object 1104 area of the virtual space structure data 114. The local coordinates 1404 area stores the display position of each object with the parent object as the origin. The world coordinates 1405 area stores the actual display position in virtual space. The local direction 1406 area stores the display direction of each object with the parent object as the origin. The world direction 1407 area stores the actual display position in virtual space. By defining the virtual space display state data 117 in this way, the virtual space display state data 117 can output information that matches the display screen in the virtual space.

Returning to FIG. 12, the virtual space display data creation unit 104 reads all stored visualization frames 113 after reflecting information (S1203), and reads the currently stored virtual space structure data from the virtual space structure data 114 (S1204).

The virtual space display data creation unit 104 reads out the avatar operation information and the railway operations system dynamic information (S1205), and determines the post-information reflection visualization frame to be displayed (S1206). For example, in the case of the multiple timetable display example, when avatar operation information is received in which the operation target is "Line P" and the operation content is "Grab with both hands and pull", the virtual space display data creation unit 104 determines the comparison line visualization frame in which the display operation 803 area of the post-information reflection visualization frame 113 matches this information, as the display target. In the case of the track information display example, when avatar operation information is received in which the operation target is "Edge of train pa stopped at station C" and the operation content is "Grab and pull", the virtual space display data creation unit 104 determines the track information visualization frame in which the display operation 803 area of the post-information reflection visualization frame 113 matches this information, as the display target. In addition, when the virtual space display data creation unit 104 receives operation information that only moves the visualization frame after reflecting information contained in the current virtual space display state data 117, it determines that the visualization frame after reflecting information contained in the current virtual space display state is to be displayed, and when error information is acquired in the railway operation system dynamic information, it determines that the visualization frame containing the error information is to be displayed.

Next, the virtual space display data creation unit 104 stores the value of the railway operation system dynamic information in the display target visualization frame (S1207), and updates the virtual space structure data and information reflection (S1208). This step performs the same processing as the virtual space data construction unit 103.

The virtual space display data creation unit 104 extracts elements having the From reference information of the visualization frame after reflecting information of the display target from the reconstructed virtual space structure data, and links them to the visualization frame after reflecting information of the display target (S1209, S1210). For example, in the multiple timetable display example, the virtual space display data creation unit 104 extracts the station axis of Station A and the station axis of Station D having the From reference information of the comparison route diagram visualization frame, and links them to the station axis of Station A and the station axis of Station D of the comparison route diagram visualization frame. In the platform information display example, the station axis of Station C having the From reference information of the platform information visualization frame is extracted, and links it to the platform information of Station C of the platform information visualization frame. Similarly, the virtual space display data creation unit 104 extracts elements having the To reference information of the visualization frame after reflecting information of the display target from the reconstructed virtual space structure data, and links them to the visualization frame after reflecting information of the display target (S1211, S1212). For example, in the platform information display example, the virtual space display data creation unit 104 extracts all train networks that use each platform at Station C and have To reference information in the platform information visualization frame, and connects them to each platform at Station C in the platform information visualization frame.

The virtual space display data creation unit 104 determines the data display position in the virtual space according to each connected element and the contents of each visualization frame after information reflection (S1213). At this time, the connection part based on the From reference information determines the display position of the visualization frame after information reflection based on the main diagram, and the connection part based on the To reference information determines the display position of the main diagram based on the visualization frame after information reflection. For example, in the multiple diagram display example, the virtual space display data creation unit 104 determines the display position by distorting the comparison route diagram visualization frame in a three-dimensional direction so that the ratio of travel time or travel distance between each station corresponds to the ratio. In the platform information display example, the virtual space display data creation unit 104 calculates the display interval of each platform of the platform information from the length of the user's pulling action stored in the operation support information 1305 area of the avatar operation log 116 and the latitude and longitude of each platform stored in the platform information visualization frame, and determines the display position so as to be perpendicular to the station axis of the main diagram. Furthermore, the virtual space display data creation unit 104 translates the main diagram train network that uses each platform in the three-dimensional direction so as to match the three-dimensional display position of each platform, and determines the display position.

The virtual space display data creation unit 104 updates the virtual space display state based on the determined display position (S1214).

By carrying out the above steps S1201 to S1214, the virtual space display data creation unit 104 can determine the display content from the avatar operation and the railway operation system dynamic information, and create the virtual space display state based on the virtual space structure data, enabling data display that matches the user's operation.

So far, we have explained each functional module of the data display system 100 based on an example of a multiple timetable display (Fig. 4) and an example of track number information display (Fig. 5), but by using each functional module, it is also possible to display other railway information. Display output examples will be explained using Figs. 15 to 23.

Figures 15 to 20 are examples of adding information to the main diagram other than the information originally shown on the diagram. In Figure 15, the people flow information system 203 distributes actual or predicted data on the destinations of railway users calculated based on the results of tallying up probe data of railway users, etc., and when a user taps on the arrival node of a station with a train on the main diagram, the data display system 100 displays the destinations of railway users radially, and displays the number of people at each destination according to the thickness of the arrow pointing to each destination. This allows the user, the dispatcher, to instantly know the impact on other lines or events when a delay occurs in a certain section.

In FIG. 16, the traffic control system 201 distributes train sequence constraint information, and when a user grabs the arrival or departure node of a station with a train on the main diagram and pulls it toward them, the data display system 100 displays the arrival or departure nodes of the train network that impose the sequence constraint before and after that train so that they are gathered on a three-dimensional axis. This allows the user, the dispatcher, to instantly recognize the trains that are affected by the traffic rescheduling.

In FIG. 17, the vehicle management system 202 distributes vehicle inspection schedule information, and when a user grabs and pulls a train edge between stations, the data display system 100 displays a time axis in a three-dimensional direction from the train edge, and displays the inspection period on the time axis. This allows the user, a dispatcher, to consider changes to vehicle operations on the timetable diagram.

In FIG. 18, the traffic control system 201 distributes train vehicle operation information, and when a user grabs the end node of a train on the main timetable and pulls it down, the data display system 100 displays potential destinations of the vehicles used by the train in a radial pattern, and displays the actual destination in a bold line. This allows the user, the dispatcher, to consider changes to vehicle operation on the timetable diagram.

In FIG. 19, the vehicle management system 202 distributes surveillance camera information from inside the train, and when the user selects a train network with a main timetable, the data display system 100 displays the surveillance camera information from the train edge between the stations through which the train is currently traveling. This allows the user, the dispatcher, to seamlessly grasp the situation on the scene on the timetable diagram.

In FIG. 20, the people flow information system 203 distributes the actual or predicted congestion rate of each train, and the actual or predicted number of passengers boarding and alighting at each station, and when the user moves to view the main diagram from the side, the data display system 100 displays each edge of the train network in a raised manner according to the degree of congestion. This allows the user, the dispatcher, to intuitively understand the difference in the congestion rate of each train.

Figure 21 is an example of dividing the main train timetable diagram. In a planar train timetable diagram, a line whose destination branches off along the way is displayed under one of the destinations, but the data display system 100 displays both train timetables that branch off from the branching station. It looks like two pieces of paper stacked on top of each other, and the user can view the post-branch train timetables on top of each other or separately by simply turning the page over. This allows the user, the dispatcher, to intuitively understand the relationship between the train at the branching point and the train from which it branched off.

Figure 22 is another pattern of an example of displaying multiple timetables. The data display system 100 displays a timetable diagram of another line where a transfer is possible at a certain station in a three-dimensional direction so that the transferable stations overlap. At this time, the display position is determined so that when viewed from the side, the travel distance and travel time between stations is reflected, as in a line map. Transferable stations may not only be displayed overlapping, but may also be displayed slightly shifted depending on the time it takes to transfer. Also, the timetable displayed here is not limited to a train timetable, and other public transportation such as buses may be used. This allows the user, the dispatcher, to understand the general relationship between the multiple timetables.

FIG. 23 is a derivative example of FIG. 22. In FIG. 22, the data display system 100 determined the display position based on the timetable diagram so that it would look like a route map when viewed from the side, but in FIG. 23, the data display system 100 determines the display position of the timetable based on the route map so that the timetable diagram can be seen when viewed from the side.

With the above visualization examples, the data display system 100 can display various railway information in response to user operations. Note that these are merely examples, and in practice, only the necessary display output examples can be selected and used, or new display output examples can be created and used.

In this way, according to this embodiment, a data display system can be created that extracts and displays the necessary information in accordance with the user's operations based on a single timetable diagram, reducing the burden on the user (the dispatcher) of understanding the situation and securing the resources to consider optimal train operations, allowing the provision of a train operation service that satisfies railway passengers.

Specifically, in a railway business system (data display system 100) that uses a computer having a processor and memory to collectively display multiple pieces of railway information in a virtual space, the railway business system has a data display device (UI device 512) for collectively displaying the information in the virtual space, and the data display device is connected via a network to a computer (user terminal 300) provided in a railway vehicle yard, a line including stations, and a control room in the real space, the multiple pieces of railway information are obtained from other railway business systems 200 and stored in the memory, and information on the user's avatar operation performed in the virtual space is obtained from the user terminal 300 and stored in the memory, and the computer in the railway vehicle yard and the control room are used to display the information. When accessing a virtual space, combining the stored visualization methods for the multiple railway information, determining the data display position in multiple dimensions of the virtual space based on the stored avatar operation information of the user and dynamic information of the railway business system, and drawing the created virtual space display state based on the determined data display position, the dynamic information of the railway business system is read, and as a visualization method for the railway information, a visualization frame after information reflection that reflects the multiple railway information in a visualization frame previously stored in the memory, and information of virtual space structure data that has reference information for the visualization frame after information reflection added to the main diagram are updated, virtual space display state data is created or updated, and displayed together on the created or updated main diagram.

In other words, by allowing the dispatcher to change the display of multiple railway information items in real time, the dispatcher does not need to extract and combine the information required for command from multiple charts, reducing the burden of understanding the situation in dispatching work and providing support for understanding the situation according to the dispatcher's level of proficiency. This allows the dispatcher to secure the resources to consider optimal train operations and provide a train operation service that satisfies railway passengers.

100: Data display system, 200: Railway business system, 201: Traffic management system, 202: Vehicle management system, 203: People flow information system, N1, N2: Network, 500: Storage device, 510: Memory, 511: CPU, 101: Railway business system information acquisition unit, 102: Avatar operation information acquisition unit, 103: Virtual space data construction unit, 104: Virtual space display data creation unit, 105: Display result output unit, 111: Railway business system static information, 112: Visualization frame, 113: Visualization frame after information reflection, 114: Virtual space structure data, 115: Railway business system dynamic information, 116: Avatar operation log, 117: Virtual space display state data

Claims

A data display device for a virtual space command center that uses a computer having a processor and a memory to display multiple pieces of railway information together in a virtual space,
The processor,
Acquire the plurality of railway information and store it in the memory;
acquiring avatar operation information of a user performed in the virtual space and storing the information in the memory;
Combining the stored visualization methods for the plurality of railway information;
determining a data display position in multiple dimensions of a virtual space according to the stored user's avatar operation information and railway operation system dynamic information;
drawing a virtual space display state created based on the determined data display position;
A data display device comprising:
2. The data display device according to claim 1,
The data display device is a data display device in a virtual space that displays a plurality of pieces of railway information together in a main diagram in the virtual space,
The processor,
In the above combination, a method for visualizing railway information including a train schedule is combined,
In the drawing, the drawings are displayed together in the main diagram.
A data display device comprising:
3. The data display device according to claim 2,
The processor,
As a method for visualizing the railway information, a visualization frame is created in which a plurality of pieces of railway information are reflected in the visualization frame previously stored in the memory,
Creating virtual space structure data in which reference information of the visualization frame after reflecting information is added to the main diagram.
A data display device comprising:
4. The data display device according to claim 3,
The processor,
determining a post-information-reflection visualization frame to be displayed based on the avatar operation information, creating virtual space display state data using the virtual space structure data and the post-information-reflection visualization frame to be displayed, and displaying the data together on the main diagram;
A data display device comprising:
5. The data display device according to claim 4,
The processor,
read out the dynamic information of the railway operation system, update the visualization frame after reflecting the information and the virtual space structure data, create or update virtual space display state data, and display the created or updated virtual space display state data together with the main diagram diagram;
A data display device comprising:
6. The data display device according to claim 5,
The processor,
The main diagram is divided into the overall diagram network, train network, station axis, time section axis, edges, and nodes, and reference information of the visualization frame after reflecting the above information is given to these elements.
A data display device comprising:
6. The data display device according to claim 5,
The processor,
an element having reference information of the visualization frame after reflecting the information to be displayed in the main diagram and the visualization frame after reflecting the information to be displayed are linked, and a data display position in a virtual space is determined for the data of the main diagram and the visualization frame after reflecting the information to be displayed in accordance with a visualization rule that matches the visualization frame after reflecting the information to be displayed;
A data display device comprising:
8. The data display device according to claim 7,
The processor,
determining a visualization frame after reflecting the information to be displayed based on the error content of the dynamic information of the railway operation system;
A data display device comprising:
9. The data display device according to claim 8,
The processor,
As the avatar operation information, at least information for touching each element in the virtual space, moving each element, moving the position of the avatar in the virtual space, and changing the line of sight in the virtual space is read from the memory.
A data display device comprising:
10. The data display device according to claim 9,
The processor,
A comparison route diagram visualization frame showing a comparison route that has the same departure station and destination station and runs parallel to the comparison route is read from the memory, and reference information of the comparison route diagram visualization frame is assigned to a station axis in the main diagram where transfer to the comparison route can be performed,
Upon receiving avatar operation information corresponding to the comparative route diagram visualization frame, obtain real-time operation information, reflect the information in the main diagram and the comparative route diagram visualization frame, generate a phase of the comparative route diagram visualization frame in a three-dimensional direction so that the travel distance or travel time ratio between each station matches the length between each station, and determine a data display position.
A data display device comprising:
10. The data display device according to claim 9,
The processor,
A platform information visualization frame showing platform information of a certain station is read from the memory, and reference information of the platform information visualization frame is assigned to the station axis of the station and the train network running within the range of the platform information in the main diagram,
Upon obtaining avatar operation information corresponding to the platform information visualization frame, obtain real-time operation information and reflect it in the main diagram, determine the display position of the platform information visualization frame, and change the display position of the train network on the diagram in accordance with the display position of the running location on the platform information visualization frame.
A data display device comprising:
12. The data display device according to claim 11,
The processor,
Adding reference information of the platform information visualization frame to the edge of the train that stops at the corresponding station in the platform information visualization frame in the main diagram and the train network;
Upon obtaining avatar operation information corresponding to the platform information visualization frame, obtain real-time operation information and reflect it in the main diagram, determine the display position of the platform information visualization frame based on the stop station of the train edge operated by the avatar as a starting point, and change the display position of the train network running before and after the train operated by the avatar according to the display position of the platform information visualization frame.
A data display device comprising:
10. The data display device according to claim 9,
The processor,
generating visualization frames corresponding to passenger destination information, train sequence constraint information, vehicle inspection information, and train operation information, and assigning reference information of each of the visualization frames to nodes and edges of corresponding stations in the main diagram;
Upon acquiring avatar operation information corresponding to each of the visualization frames, acquire railway operation system dynamic information, reflect the information in each of the visualization frames, and determine the display positions of each of the visualization frames in a three-dimensional direction from each element of the main diagram.
A data display device comprising:
A data display method for a virtual space command center that uses a computer having a processor and a memory to collectively display multiple pieces of railway information in a virtual space, comprising:
The processor,
Acquire the plurality of railway information and store it in the memory;
acquiring avatar operation information of a user performed in the virtual space and storing the information in the memory;
Combining the stored visualization methods for the plurality of railway information;
determining a data display position in multiple dimensions of a virtual space according to the stored user's avatar operation information and railway operation system dynamic information;
drawing a virtual space display state created based on the determined data display position;
23. A data display method comprising:
A railway business system that uses a computer having a processor and a memory to collectively display multiple railway information items in a virtual space,
The railway operations system includes:
a data display device for displaying the data collectively in the virtual space, the data display device being connected via a network to a computer installed in a railroad car yard, a line including a station, and a control room in the real space;
acquiring the plurality of railway information from another railway business system and storing the information in the memory;
acquiring avatar operation information of a user performed in the virtual space from the computer and storing the information in the memory;
a computer in the vehicle yard of the railway and a computer in the control room access the virtual space, and combine the stored visualization methods of the plurality of pieces of railway information;
determining a data display position in multiple dimensions of a virtual space according to the stored user's avatar operation information and railway operation system dynamic information;
When drawing a virtual space display state created based on the determined data display position, the railway operation system dynamic information is read out, and as a method for visualizing the railway information, a visualization frame after information reflection in which a plurality of railway information items are reflected in a visualization frame previously stored in the memory and information of virtual space structure data in which reference information of the visualization frame after information reflection is added to the main diagram chart is updated to create or update virtual space display state data, and the data is displayed together on the created or updated main diagram chart.
A railway operations system characterized by: