EP4620776A1

EP4620776A1 - Data display device, data display method, and railway business system

Info

Publication number: EP4620776A1
Application number: EP23891248.9A
Authority: EP
Inventors: Yukiko Kinoshita
Original assignee: Hitachi Ltd
Current assignee: Hitachi Ltd
Priority date: 2022-11-18
Filing date: 2023-10-12
Publication date: 2025-09-24
Also published as: JP2024073739A; AU2023382929A1; WO2024106090A1

Abstract

In a data display device for collectively displaying a plurality of railway information items in a virtual space using a computer having a processor and a memory, the processor acquires the plurality of railway information items from a railway business system, stores the plurality of railway information items in the memory, acquires information of an avatar operation performed by a user in the virtual space from a user terminal, stores the avatar operation information of the user in the memory, combines visualization methods for the stored plurality of railway information items, determines a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information, and draws a virtual space display state created based on the determined data display position.

Description

TECHNICAL FIELD

The present technology relates to a data display device, a data display method, and a railway business system.

BACKGROUND ART

For information necessary for railway business, Patent Document 1 discloses a device that displays data related to users for each combination of departure points and arrival points in a transportation line network in a three-dimensional virtual space. Patent Document 1 discloses the following: "In a three-dimensional virtual space, a first layer in which an identifier for at least one of points constituting the transportation line network is disposed and a second layer in which identifiers for all or some of the other points are disposed are arranged at a predetermined interval. Then, for each combination in which a point corresponding to the identifier of the first layer is the departure point and a point corresponding to the identifier of the second layer is the arrival point, an indication line connecting the identifier of the departure point and the identifier of the arrival point is drawn in a form based on data related to the number of users corresponding to the combination". Patent Document 2 discloses a device that colors trains on a train graph to display the degree of train congestion. Patent document 2 discloses that "a creation unit 26 creates a train graph in which train lines with different colors, different line types, and different thicknesses are displayed depending on the occupancy rate of a target section and creates display data for the train graph in which the train lines that visually change depending on the occupancy rate are displayed".

CITATION LIST

PATENT DOCUMENT

Patent Document 1: Patent Document 1: JP 2015-20650 A
Patent Document 2: JP 2006-327239 A

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

Patent Document 1 discloses a display method that encourages intuitive understanding, but only one type of information, that is, arrival and departure information of the user can be displayed. In Patent document 2, two types of information, that is, the operation information and degree of congestion of the train are displayed on one graph. However, on a congested train graph, it is difficult to see a difference between colors, and it is difficult to know a difference between the degrees of congestion of the trains classified as the same color. Therefore, it is difficult to extract necessary information such as which trains are particularly crowded. For this reason, in order to understand an operation state, a dispatcher needs to acquire necessary information from graphs on a plurality of displays, the contents of which are sequentially changed, and to associate the information. Therefore, the effect of reducing the burden of understanding the situation in dispatcher work is limited. Further, for the display of information by a display, since an operation device and a display screen are not integrated, it is difficult to perform an intuitive operation.
Accordingly, an object of the present invention is to seamlessly display a plurality of railway information items, which are difficult to display in their entirety on a two-dimensional surface, through an intuitive operation of a dispatcher.

SOLUTIONS TO PROBLEMS

According to the present invention, there is provided a data display device for collectively displaying a plurality of railway information items in a virtual space using a computer having a processor and a memory. The processor acquires the plurality of railway information items, stores the plurality of railway information items in the memory, acquires information of an avatar operation performed by a user in the virtual space, stores the avatar operation information of the user in the memory, combines visualization methods for the stored plurality of railway information items, determines a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information, and draws a virtual space display state created based on the determined data display position.

EFFECTS OF THE INVENTION

According to the present invention, a plurality of railway information items, which are difficult to display in their entirety on a two-dimensional surface, can be displayed by an intuitive operation of a dispatcher.

BRIEF DESCRIPTION OF THE DRAWINGS

Fig. 1 shows an example of a network configuration of a data display system and related systems.
Fig. 2 shows an example of a hardware configuration of the data display system.
Fig. 3 shows an overall flowchart of the data display system.
Fig. 4 shows an example of display output in a virtual space by the data display system.
Fig. 5 shows an example of display output in the virtual space by the data display system.
Fig. 6 is a flowchart of a virtual space data construction unit of the data display system.
Fig. 7 shows an example of a data structure of a visualization frame of the data display system.
Fig. 8 shows an example of a data structure of an information-reflected visualization frame of the data display system.
Fig. 9 shows an example of a train graph visualization frame of the data display system.
Fig. 10 shows an example of a platform information visualization frame of the data display system.
Fig. 11 shows an example of a data structure of a virtual space structure data of the data display system.
Fig. 12 is a flowchart of a virtual space display data creation unit of the data display system.
Fig. 13 shows an example of a data structure of an avatar operation log of the data display system.
Fig. 14 shows an example of a data structure of a virtual space display state of the data display system.
Fig. 15 shows an example of display output in the virtual space by the data display system.
Fig. 16 shows an example of display output in the virtual space by the data display system.
Fig. 17 shows an example of display output in the virtual space by the data display system.
Fig. 18 shows an example of display output in the virtual space by the data display system.
Fig. 19 shows an example of display output in the virtual space by the data display system.
Fig. 20 shows an example of display output in the virtual space by the data display system.
Fig. 21 shows an example of display output in the virtual space by the data display system.
Fig. 22 shows an example of display output in the virtual space by the data display system.
Fig. 23 shows an example of display output in the virtual space by the data display system.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and some omissions and simplifications are made as appropriate for clarity of explanation. The present invention can be embodied in various other forms. Unless otherwise specified, each component may be singular or plural.
The position, size, shape, range, and the like of each component shown in the drawings may not indicate the actual position, size, shape, range, and the like of each component in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the position, size, shape, range, and the like of each component disclosed in the drawings.
In the following description, various types of information are described using expressions such as a "database", a "table", and a "list". However, the various types of information may be expressed using data structures other than these. An "XX table", an "XX list", and the like may be referred to as "XX information" in order to indicate that they are not dependent on the data structure. In the description of identification information, when expressions, such as "identification information", an "identifier", a "name", an "ID", and a "number", are used, they are interchangeable.
When there are a plurality of components having the same or similar functions, different subscripts may be attached to the same reference numerals in the description of the plurality of components. However, when it is not necessary to distinguish between the plurality of components, the subscripts may be omitted in the description of the plurality of components.
In addition, in the following description, a process performed by executing a program may be described. However, the program is executed by a processor (for example, a CPU or a graphics processing unit (GPU)) to perform a given process while appropriately using, for example, a storage resource (for example, a memory) and/or an interface device (for example, a communication port). Therefore, the subject of the process may be the processor. Similarly, the subject of the process performed by executing the program may be a controller, a device, a system, a computer, or a node having the processor. The subject of the process performed by executing the program may be a calculation unit and may include a dedicated circuit (for example, a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC)) that performs a specific process.
The program may be installed in a device, such as a computer, from a program source. For example, the program source may be a program distribution server or a computer-readable storage medium. When the program source is the program distribution server, the program distribution server may include a processor and a storage resource that stores the program to be distributed, and the processor of the program distribution server may distribute, to other computers, the program to be distributed. Furthermore, in the following description, two or more programs may be implemented as one program, or one program may be implemented as two or more programs.

[Embodiment 1]

Fig. 1 is a block diagram showing a data display system 100 according to this embodiment and shows related systems connected to the data display system 100.
The data display system 100 is configured to include a railway business system information acquisition unit 101, an avatar operation information acquisition unit 102, a virtual space data construction unit 103, a virtual space display data creation unit 104, and a display result output unit 105. Railway business system static information 111 and railway business system dynamic information 115 are stored by the railway business system information acquisition unit 101, and an avatar operation log 116 is stored by the avatar operation information acquisition unit 102. In addition, the virtual space data construction unit 103 creates an information-reflected visualization frame 113 and virtual space structure data 114, using a visualization frame 112, and stores them. The virtual space display data creation unit 104 creates virtual space display state data 117, using the information-reflected visualization frame and the virtual space structure data 114, and stores the virtual space display state data 117.
The data display system 100 is connected to a railway business system 200 via a communication network N1. These are systems that distribute data required by the data display system 100. The railway business system 200 refers to all systems required for railway business, and examples thereof include an operation management system 201, a vehicle management system 202, and a people flow information system 203. The operation management system 201 is a system that manages the operation of trains as disclosed in JP 2005-138710 A . The operation management system 201 manages information, such as train positions, surveillance cameras at stations, and railway crossings, that can be obtained from a railway ground system. The vehicle management system 202 is a system for managing railway vehicles as disclosed in JP 2022-536059 A . The vehicle management system 200 manages information, such as a speed, load weight, and a vehicle camera, that can be obtained from a railway vehicle system. The people flow information system 203 is a system that manages information related to railway users as disclosed in JP 2002-187551 A and JP 2014-206829 A . The people flow information system 203 manages information related to the railway users, such as probe data, ticket gate data, SNS data, and route search results of the railway users.
Further, the data display system 100 is connected to a user terminal 300 via a communication network N2, transmits information to be displayed on an output screen of the user terminal 300, and acquires operation information of the user terminal 300. A virtual space is displayed on the user terminal 300, and an avatar in the virtual space is operated. Here, the virtual space refers to a space that is virtually constructed by digital technology. In particular, the virtual space is not a two-dimensional space, but is mainly a three-dimensional space with depth. In addition, the avatar refers to an agent that moves around in the virtual space and is operated by the user. The avatar reproduces the operation, characteristic body parts, and motion of the user in the virtual space and reproduces, for example, the body parts of the user, such as arms, hands, and fingers, and the motions thereof. An output device of the user terminal 300 may be a device, such as a head-mounted display, that blocks the field of view with a display or a device, such as a brain-machine interface (BMI), that directly displays the field of view on the brain. An input device of the user terminal 300 is for operating the avatar and may be a controller, a sensor for recognizing hand gestures of the user, a BMI for acquiring brain information, or the like. The user terminal 300 is managed, for example, by a transportation company that operates a predetermined transportation facility and is used by a system user who uses the data display system 100, for example, a dispatcher of the transportation company. The communication networks N1 and N2 may be a common network or may be networks using different protocols.
Fig. 2 shows an example of a hardware configuration of the data display system 100. The data display system 100 is configured as a device that can perform various types of information processing, for example, an information processing device such as a computer. The data display system 100 includes a storage device 500, a memory 510, a calculation device typified by a CPU (hereinafter, simply referred to as a CPU) 511, a UI device 512, and a communication device 513.
The storage device 500 is a non-volatile storage device, such as an SSD or a hard disk drive, and stores a program for implementing each of the units 101 to 105 (see Fig. 1), which are functional modules executed by the data display system 100, and data such as data necessary for executing the functional modules or each of the data items 111 to 117 (see Fig. 1) generated by the functional modules.
The memory 510 is a volatile memory such as a RAM. When the data display system 100 starts to operate (for example, when the power is turned on), the CPU 511 reads the program from the storage device 500, deploys the program on the memory 510, and executes the program. The UI device 512 is connected to an input device (not shown), such as a keyboard, a mouse, or a controller, and an output device (not shown), such as a display, to implement a GUI. The communication device 513 performs a communication process with the external related systems via the networks N1 and N2.
In addition, the operation management system 201, the vehicle management system 202, the people flow information system 203, and the user terminal 300 shown in Fig. 1 also have the same hardware configuration as the data display system 100.
Fig. 3 shows a flow of a process of all of the functional modules of the data display system 100. This process starts at a timing when a start instruction is received from the user terminal 300.
First, the railway business system information acquisition unit 191 of the data display system 100 acquires the railway business system static information 111 (S301). Then, the virtual space data construction unit 103 of the data display system 100 constructs the information-reflected visualization frame 113 and the virtual space structure data 114, using the acquired railway business system static information 111 and the visualization frame 112 that has been stored in advance (S302). In addition, a display method that reads out the three-dimensional space, which is the virtual space, and utilizes the three-dimensional space is stored in the visualization frame 112. This makes it possible for the data display system 100 to prepare in advance the railway information to be displayed and a visualization method.
The data display system 100 repeats S304 to S307. This process is repeated at the timing (for example, every second) determined in advance by the data display system 100. First, the avatar operation information acquiring unit 102 of the data display system 100 acquires avatar operation information from the user terminal 300, that is, information obtained from the input device of the user terminal 300 (S304). The avatar operation refers to touching each element in the virtual space, moving each element, moving the position of the avatar in the virtual space, changing a line of sight in the virtual space, and the like. At this time, the avatar operation is accumulated in the avatar operation log 116. In addition, when the avatar operation is not performed, this step is skipped. The railway business system information acquisition unit 101 of the data display system 100 acquires the railway business system dynamic information 115 (S305). The virtual space display data creation unit 104 of the data display system 100 creates and updates the virtual space display state data 117 using the acquired latest avatar operation information, the railway business system dynamic information 115, and the virtual space structure data 114 (S306). This makes it possible for the data display system 100 to select the railway information and information-reflected visualization frame to be actually displayed from the prepared virtual space structure data 114 and information-reflected visualization frame 113, to read out the three-dimensional space, and to create data for displaying information using the three-dimensional space.
The display result output unit 105 of the data display system 100 outputs the virtual space display state data 117 and transmits the virtual space display state data 117 to the user terminal 300 (S307). This makes it possible for the data display system 100 to display the created display data.
As described above, the data display system 100 can prepare the railway information to be displayed and the visualization method in advance, determine railway information to be actually displayed among a plurality of railway information items and a method for displaying the railway information, based on the avatar operation information, such as touching each element in the virtual space, moving each element, moving the position of the avatar in the virtual space, and changing the line of sight in the virtual space, and the railway business system dynamic information, and display the plurality of railway information items in a plurality of dimensions.

[Embodiment 2]

In Embodiment 2, details of each functional module of the processing flow of the data display system 100 will be described using, as an example, a case where Embodiment 1 particularly displays railway information, using a railway operation management chart (train graph) as a base chart. Hereafter, the train graph, which is the base charge, is referred to as a main train graph.
Before the detailed description of each functional module and data, an example of display output in the virtual space, which will be described in this embodiment, will be described using Figs. 4 and 5.
For example, as shown in Fig. 4, the data display system 100 displays a combination of a line L1 that is displayed in the main train graph and a comparative line L2 that has the same departure and arrival stations, but runs in parallel. When the line L1 displayed on the main train graph runs through A, B, C, and D stations and the comparative line L2 runs through A, E, F, and D stations, (the display result output unit 105 of) the data display system 100 outputs data for displaying the main train graph on a two-dimensional surface. When the user performs an operation of grabbing the main train graph with both hands and pulling the main train graph through the avatar, the virtual space display data creation unit 104 of the data display system 100 generates a curved surface that intersects the plane of the main train graph on a straight line indicating the A and D stations and that is uneven in a direction perpendicular to the plane, and creates data for displaying the train graph of the comparative line on this curved surface, which will be described below. In addition, the curved surface is generated such that a travel distance or a travel time is matched with a length between the stations. A line T1 is an example of a train that runs on the line L1, and a line T2 is an example of a train that runs on the line L2. Hereafter, this example will be referred to as an example of display of a plurality of train graphs. The line may include a vehicle depot.
For example, as shown in Fig. 5, the data display system 100 displays a combination of the line L1 displayed in the main train graph and platform information (schematic line map) of a certain station in the main train graph. When the line L1 displayed in the main train graph runs through the A, B, C, and D stations, (the display result output unit 105 of) the data display system 100 outputs data for displaying the main train graph on the plane. In a case where the user performs an operation of grabbing a train stopped at the C station and pulling the train through the avatar, when the C station has platforms C1, C2, and C3, the virtual space display data creation unit 104 creates data for displaying the platforms C1, C2, and C3 parallel to an axis of the C station in a third axis direction from the station in the main train graph and for moving trains, which run on each platform during the time periods before and after the train, to the main train graph to the platforms and displaying the trains, which will be described below. Hereafter, this example is referred to as an example of display of platform information.
As described above, the data display system 100 displays a plurality of railway information items only at necessary locations operated by the user, using a plurality of dimensions, such that the user can intuitively and seamlessly view the information that the user wants. Next, a configuration for implementing the display shown in Figs. 4 and 5 will be described.
Fig. 6 shows a flow of a process of the virtual space data construction unit 103 which is a functional module of the data display system 100. The virtual space data construction unit 103 generates a train graph frame of a target line, using the visualization frame 112 (S601).
Fig. 7 shows an example of a data structure of the visualization frame 112 stored in the data display system 100. The visualization frame indicates a data visualization rule for displaying data. In the data display system 100, the virtual space data construction unit 103 and the virtual space display data creation unit 104 combine the visualization frame 112 with data required by the visualization frame 112 in the railway business system static information 111 and the railway business system dynamic information 115 to generate the information-reflected visualization frame 113, and the virtual space display data creation unit 104 uses the information-reflected visualization frame 113 to create the information-reflected visualization frame 113. For the visualization frame stored in the data display system 100, necessary input data and the data visualization rule are designed and stored in advance according to a command operation of the railway company.
As shown in Fig. 7, the visualization frame has a region of a frame ID 701, a region of a display link 702, a region of a display operation 703, and a region of a template 704. A name or an identification code for identifying a frame is stored in the region of the frame ID 701. An element that is a display starting point of the visualization frame among elements obtained by dividing the main train graph into an entire train graph network, a train network, a station axis, a time section axis, an edge, and a node is stored in the region of the display link 702. There are two types of storage methods of "From" and "To" as the display link. When the visualization frame is displayed using the main train graph as a starting point, the element is stored as "From". When the main train graph is displayed using the visualization frame as a starting point, the element is stored as "To". A user's operation that triggers the display of the visualization frame is stored in the region of the display operation 703. A description of a visualization rule for necessary data is stored in the region of the template 704.
A template ID "Tmp001" is shown as an example of the template. The template has a region of an object ID 705, a region of an object name 706, a region of an object type 707, a region of a parent object 708, and a region of a reference object 709. An identification code for identifying an object required by this template is stored in the region of the object ID 705. The name of the object required by this template is stored in the region of the object name 706. The display type of each object is stored in the region of the object type 707. When it is desired to make each object have a parent-child relationship with another object, the object ID of a parent object is stored in the region of the parent object 708. When it is desired to make each object have a reference relationship with another object, the object ID of a referenced object is stored in the region of the reference object 709.
When data is stored according to the template, the visualization frame 112 determines a data visualization method based on the visualization rule based on the relationship between the parent object and the reference object shown in the template. In addition, the visualization rule refers to a source code that performs a predetermined operation, such as movement or rotation, on the object input based on the template in the virtual space and is stored as a portion of the template in the visualization frame. Fig. 7 shows an example of the data structure of the visualization frame before the railway business system static information 111 and the railway business system dynamic information 115 are reflected. The display link, the display operation, and the template are predetermined, but temporary data is stored in the items because the actual values are not stored.
Fig. 8 shows an example of the data structure of the information-reflected visualization frame 113 after the railway business system static information 111 and the railway business system dynamic information 115 are reflected. The information-reflected visualization frame 113 has a region of a frame ID 801, a region of a display link 802, a region of a display operation 803, and a region of a template 804. The template has a region of an object ID 805, a region of an object name 806, a region of an object type 807, a region of a parent object 808, and a region of a reference object 809. All of the regions are the same as those of the visualization frame 112. Unlike the visualization frame 112, specific data, such as a display link and an object ID and an object name in the template, are stored in the information-reflected visualization frame 113.
The use of the visualization frame 112 makes it possible for the data display system 100 to display necessary railway information with the visualization method matched with the operation suitable for the information.
An example of the visualization frame 112 will be described using Figs. 9 and 10. Fig. 9 shows a visualization frame (train graph visualization frame) in the example of the display of a plurality of train graphs shown in Fig. 4. A train graph visualization rule is stored in the template, the station axis is stored as "From" in the display link, and "grab and pull the entire train graph (the main train table is always displayed)" is stored in the display operation. Therefore, when the user grabs and pulls the entire main train graph, the data display system 100 can display the train graph of the comparative line, using the station axis of the main train graph as a starting point. In addition, station arrangement information and operation management information are reflected as the railway business system static information and the railway business system dynamic information in the visualization frame, respectively, to create the information-reflected visualization frame, which makes it possible for the data display system 100 to display the actual train graph in real time.
Fig. 10 shows a visualization frame (platform information visualization frame) in the example of the display of the platform information shown in Fig. 5. A platform (schematic line map) visualization rule is stored in the template, and an edge and a train network are stored as "From" and "To" in the display link, respectively. "Grab and pull a train stopped at a certain station" is stored in the display operation. Therefore, when the user grabs and pulls a train stopped at a certain station on the main train graph, the data display system 100 can display platform information (schematic line map), using the edge of the train to be operated as a starting point. In addition, station arrangement information and operation management information are reflected as the railway business system static information and the railway business system dynamic information in the visualization frame, respectively, to create the information-reflected visualization frame, which makes it possible for the data display system 100 to display the train network before and after the train to be operated on the platform information (schematic line map).
Returning to Fig. 6, then, the virtual space data constructing unit 103 generates virtual space structure data in which the value of the main train graph has been reflected (S602). Details will be described below. The virtual space data construction unit 103 repeats Steps S604 to S609 according to the number of visualization frames to be displayed. The virtual space data construction unit 103 generates the visualization frame to be displayed (S603). For example, as described above, the train graph visualization frame and the platform information visualization frame are generated.
The virtual space data constructing unit 103 repeats Steps S604 to S609 for each usage data item in the visualization frame. When the usage data is static data (S604; YES), the virtual space data construction unit 103 reads the railway business system static information 111 (S605) and reflects the read value in the generated visualization frame (S606). Then, the virtual space data constructing unit 103 outputs and updates the information-reflected visualization frame 112 (S607). When static data is used, the visualization frame in which the value has been reflected is output. However, when static data is not used, the same frame as the visualization frame 112 in which the value has not been reflected is output.
Then, the virtual space data constructing unit 103 acquires an element having display link information of the information-reflected visualization frame 113 from the elements of the main train graph (S608). For example, as described above, in the example of the display of a plurality of train graphs, the display link information of the information-reflected visualization frame shows that the station axis matched with the station information of the comparative line is required. Therefore, the virtual space data construction unit 103 acquires the station axis matched with the station information of the comparative line from the main train graph. In the example of the display of the platform information, the display link information of the information-reflected visualization frame shows that the edge where the target stations are matched with each other and the train network where the target platforms are matched with each other are required. Therefore, the virtual space data construction unit 103 acquires the corresponding edge and train network from the main train graph. In addition, at this time, the avatar operation has not been performed, and the target station and the target platform have not been determined. Therefore, the edges and the train networks for all of the stations and the platforms that can be the target station and the target platform are acquired. The virtual space data constructing unit 103 gives visualization frame reference information to the acquired elements (S609). Details will be described below.
After ending all of the processes, the virtual space data constructing unit 103 outputs the virtual space structure data 114 (S610).
Fig. 11 shows a data structure example of the virtual space structure data 114. The virtual space structure data 114 has a region of an object ID 1101, a region of an object name 1102, a region of an object type 1103, a region of a parent object 1104, a region of a reference object 1105, a region of detailed information 1106, and a region of a reference frame 1107. The virtual space structure data 114 also holds detailed information that is not stored in the visualization frame.
The same values as those in the region of the object ID 705, the region of the object name 706, the region of the object type 707, the region of the parent object 708, and the region of the reference object 709 of the visualization frame 112 are stored in the region of the object ID 1101, the region of the object name 1102, the region of the object type 1103, the region of the parent object 1104, and the region of the reference object 1105. The detailed information of the railway business system static information 111 and the railway business system dynamic information 115 is stored in the region of the detailed information 1106 according to the object. For example, the departure time, the departure platform, and the like are stored in a sphere (node) where a train departs from a certain station. Therefore, the virtual space structure data 114 can hold various types of information required in various visualization frames based on the train graph visualization frame. A frame ID of a visualization frame that can be displayed from each element (object) of the train graph visualization frame, a display link, and target information of the visualization frame are stored in the region of the reference frame 1107. These values are stored through Steps S604 to S609.
The above-described processes in S601 to S610 make it possible for the virtual space data constructing unit 103 to create the virtual space structure data required for changing the display data in response to the operation of the avatar.
Fig. 12 shows a flow of a process of the virtual space display data creation unit 104. The virtual space display data creation unit 104 receives avatar operation information from the avatar operation information acquisition unit 102 and stores the avatar operation information in the avatar operation log 116 (S1201) .
Fig. 13 shows an example of the data structure of the avatar operation log 116. The avatar operation log 116 has a region of a user ID 1301, a region of a time 1302, a region of an operation target 1303, a region of an operation content 1304, and a region of operation auxiliary information 1305. A name or an identification code for identifying a user is stored in the region of the user ID 1301. The time when an operation was performed is stored in the region of the time 1302. The object ID and object name of the object on which the operation has been performed are stored in the region of the operation target 1303. The same data items as those in the region of the object ID 1101 and the region of the object name 1101 of the virtual space structure data 114 are stored in the object ID and the object name. The operation performed by the avatar, such as "grab and pull", "grab and pull with both hands", or "move", is stored in the region of the operation content 1304. The stored value is obtained by categorizing the motions of the avatar. The user terminal 300 may distribute data obtained by classifying the motions of the avatar into operation categories, and the avatar operation information acquisition unit 102 may acquire these operation categories. The user terminal 300 may distribute the motions of the user, and the avatar operation information acquisition unit 102 may acquire the motions and classify the motions into the operation categories based on the motions of the avatar. When the operation category shown in the region of the operation content 1304 is required, auxiliary information is stored in the region of the operation auxiliary information 1305. For example, when the content of the operation is "grab and pull", the pulled length is stored as the operation auxiliary information. When the content of the operation is "move", the coordinates of a movement destination are stored as the operation auxiliary information.
Returning to Fig. 12, the virtual space display data creation unit 104 reads out the current virtual space display state from the virtual space display state data 117 (S1202).
Fig. 14 shows a data structure example of the virtual space display state data 117. The virtual space state data 117 stores information for actually displaying the virtual space structure data and the information-reflected visualization frame. The virtual space display state data 117 includes a region of an object ID 1401, a region of an object name 1402, a region of a parent object 1403, a region of local coordinates 1404, a region of world coordinates 1405, a region of a local direction 1406, and a region of a world direction 1407.
The same data as that in the region of the object ID 1101, the region of the object name 1102, and the region of the parent object 1104 of the virtual space structure data 114 is stored in the region of the object ID 1401, the region of the object name 1402, and the region of the parent object 1403. The display position of each object with respect to the parent object as a starting point is stored in the region of the local coordinates 1404. The actual display position in the virtual space is stored in the region of the world coordinates 1405. The display direction of each object with respect to the parent object as a starting point is stored in the region of the local direction 1406. The actual display position in the virtual space is stored in the region of the world direction 1407. The definition of the virtual space display state data 117 in this way makes it possible to output information fitted to the display screen in the virtual space as the virtual space display state data 117.
Returning to Fig. 12, the virtual space display data creation unit 104 reads out all of the stored information-reflected visualization frames 113 (S1203) and reads out the currently stored virtual space structure data from the virtual space structure data 114 (S1204).
The virtual space display data creation unit 104 reads out the avatar operation information and the railway business system dynamic information (S1205) and determines the information-reflected visualization frame to be displayed (S1206). For example, in the case of the example of the display of a plurality of train graphs, when the avatar operation information indicating that the operation target is "platform P" and the content of the operation is "grab and pull with both hands", the virtual space display data creation unit 104 determines that the display target is a comparative line visualization frame having information matched with this information in the region of the display operation 803 in the information-reflected visualization frame 113. In the case of the example of the display of the platform information, when the avatar operation information indicating that the operation target is "an edge of train pa stopped at station C" and the content of the operation is "grab and pull", the virtual space display data creation unit 104 determines that the display target is the platform information visualization frame having information matched with this information in the region of the display operation 803 in the information-reflected visualization frame 113. In addition, when receiving operation information only for moving the information-reflected visualization frame included in the current virtual space display state data 117, the virtual space display data creation unit 104 determines that the display target is the information-reflected visualization frame included in the current virtual space display state. When error information is acquired from the railway business system dynamic information, the virtual space display data creation unit 104 determines that the display target is the visualization frame including the error information.
Then, the virtual space display data creation unit 104 stores the value of the railway business system dynamic information in the visualization frame to be displayed (S1207) and updates the virtual space structure data and the information reflection (S1208). In this step, the same process as that in the virtual space data construction unit 103 is performed.
The virtual space display data creation unit 104 extracts an element having the "From" reference information of the information-reflected visualization frame to be displayed from the reconstructed virtual space structure data and links the element to the information-reflected visualization frame to be displayed (S1209 and S1210). For example, in the example of the display of a plurality of train graph, the virtual space display data creation unit 104 extracts the station axis of station A and the station axis of station D having the "From" reference information of the comparative line train graph visualization frame and links the station axis of station A and the station axis of station D in the comparative line train graph visualization frame. In the example of the display of the platform information, the virtual space display data creation unit 104 extracts the station axis of station C having the "From" reference information of the platform information visualization frame and links the station axis to the platform information of station C in the platform information visualization frame. Similarly, the virtual space display data creation unit 104 extracts an element having the "To" reference information of the information-reflected visualization frame to be displayed from the reconstructed virtual space structure data and links the element to the information-reflected visualization frame to be displayed (S1211 and S1212). For example, in the example of the display of the platform information, the virtual space display data creation unit 104 extracts all of the train networks using each platform of station C having the "To" reference information of the platform information visualization frame and links the train networks to each platform of station C in the platform information visualization frame.
The virtual space display data creation unit 104 determines a data display position in the virtual space according to each of the linked elements and the content of each information-reflected visualization frame (S1213). At this time, a link portion by the "From" reference information determines the display position of the information-reflected visualization frame based on the main grain graph, and a link portion by the "To" reference information determines the display position of the main train graph based on the information-reflected visualization frame. For example, in the example of the display of a plurality of train graphs, the virtual space display data creation unit 104 determines the display position by distorting the comparative line train graph visualization frame in a three-dimensional direction such that the distance between the stations corresponds to the ratio of the travel time or the travel distance. In the example of the display of the platform information, the virtual space display data creation unit 104 calculates a display interval of each platform in the platform information from the length of the pulling operation of the user stored in the region of the 1305 in the avatar operation log 116 and the latitude and longitude of each platform stored in the platform information visualization frame and determines the display position such that it is perpendicular to the station axis of the main train graph. In addition, the virtual space display data creation unit 104 determines the display position by translating the train network of the main train graph that uses each platform in the three-dimensional direction so as to be matched with the display position of each platform in the three-dimensional direction.
The virtual space display data creation unit 104 updates the virtual space display state based on the determined display position (S1214).
Through the processes in Steps S1201 to S1214, the virtual space display data creation unit 104 can determine the content of display from the avatar operation and the railway business system dynamic information and create the virtual space display state based on the virtual space structure data, which enables data display according to the operation of the user.
So far, each functional module of the data display system 100 has been described based on the example of the display of a plurality of train graphs (Fig. 4) and the example of the display of the platform information (Fig. 5). However, each function module can be used to display other railway information. An example of display output will be described using Figs. 15 to 23.
Figs. 15 to 20 show examples in which information other than the information originally shown on the train graph is added to the main train graph. In Fig. 15, the people flow information system 203 distributes the actual or predicted data of the destinations of the railway users calculated based on aggregate results such as probe data of the railway users. When the user taps on a destination node of a certain station with a certain train on the main train graph, the data display system 100 displays the destinations of the railway users radially and displays the number of persons at each destination, corresponding to the thickness of an arrow pointing to each destination. Therefore, when a delay occurs in a certain section, the user, who is a dispatcher, can instantly know the impact on other lines or events.
In Fig. 16, the operation management system 201 distributes train order constraint information. When the user grabs an arrival node or a departure node of a certain station with a certain train on the main train graph and pulls it toward the user, the data display system 100 displays the arrival nodes or the departure nodes of the train network, to which the order constraints before and after the train are given, to be gathered on the axes in the three-dimensional direction. This enables the user, who is a dispatcher, to instantly recognize which trains will be affected by traffic rescheduling.
In Fig. 17, the vehicle management system 202 distributes vehicle inspection schedule information. When the user grabs and pulls a train edge between the stations, the data display system 100 displays a time axis in the three-dimensional direction from the train edge and displays the inspection time on the time axis. This enables the user, who is a dispatcher, to consider a change in the operation of the vehicle on the train graph.
In Fig. 18, the operation management system 201 distributes vehicle operation information of the train. When the user grabs an end node of a certain train in the main train graph and pulls the end node down, the data display system 100 radially displays destination candidates for the used vehicle in the train and displays the actual destination with a thick line. This enables the user, who is a dispatcher, to consider a change in the operation of the vehicle on the train graph.
In Fig. 19, the vehicle management system 202 distributes surveillance camera information in the train. When the user selects a certain train network in the main train graph, the data display system 100 displays the surveillance camera information from the train edge between the stations through which the train is currently running. This enables the user, who is a dispatcher, to seamlessly understand the aspect at the site on the train graph.
In Fig. 20, the people flow information system 203 calculates the actual or predicted congestion rate of each train and the actual or predicted number of passengers boarding and alighting at each station and distributes the calculation results. When the user moves to view the main train graph from the side, the data display system 100 displays each edge of the train network such that the edge is raised according to the degree of congestion. This enables the user, who is dispatcher, to intuitively understand a difference in congestion rate between the trains.
Fig. 21 shows an example in which the main train graph is divided. In the two-dimensional train graph, the line in which the destinations branch off is displayed under one of the destinations. The data display system 100 displays both train graphs branching off from a branch station. The two train graphs look like two pieces of paper overlapping each other such that the user can overlap the branched train graphs or view the branched train graphs separately by operating the branched train graphs like turning a page of paper. This enables the user, who is a dispatcher, to intuitively understand a relationship between a train at a branch destination and a train at a branch source.
Fig. 22 shows another pattern of the example of the display of a plurality of train graphs. The data display system 100 displays a train graph of another line to which the railway user can transfer at a certain station in the three-dimensional direction such that the transferable stations overlap each other. At this time, the display position is determined such that the travel distance or the travel time between the stations is reflected as in a line map when viewed from the side. The transferable stations may be displayed not only so as to overlap each other but also so as to slightly deviate from each other depending on the time required for transfer. In addition, the graph displayed here is not limited to the train graph, but graphs for other public transportation, such as buses, may be used. In this case, the user, who is dispatcher, can understand the outline of the relationship between a plurality of graphs.
Fig. 23 shows a derivative example of Fig. 22. In Fig. 22, the data display system 100 determines the display position based on the train graph such that the train graph looks like a line map when viewed from the side. However, in Fig. 23, the data display system 100 determines the display position of the train graph such that the train graph can be seen when viewed from the side.
With the above-described example of the visualization, the data display system 100 can display various types of railway information in response to the operation of the user. In addition, these are only examples. In practice, only the necessary example of display output is selected and used, or a new example of display output is created and used.
As described above, according to this embodiment, it is possible to create a data display system that extracts and displays necessary information based on one train graph in response to an operation of the user. The user, who is a dispatcher, can have reduced burden of understanding the situation, secure resources to consider optimal train operations, and provide train operation services that satisfy the railway users.
Specifically, in a railway business system (data display system 100) that collectively displays a plurality of railway information items in a virtual space using a computer having a processor and a memory, the railway business system has a data display device (UI device 512) that collectively displays the plurality of railway information items in the virtual space and that is connected to a computer (user terminal 300) provided in a railway vehicle depot, a line including stations, or a control room in a real space via a network. The railway business system acquires the plurality of railway information items from another railway business system 200, stores the plurality of railway information items in the memory, acquires information of an avatar operation performed by a user in the virtual space from the user terminal 300, and stores the avatar operation information of the user in the memory. The computer in the railway vehicle depot and the computer in the control room access the virtual space and combine visualization methods for the stored plurality of railway information items. The railway business system determines a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information. When drawing a virtual space display state created based on the determined data display position, the railway business system reads out the railway business system dynamic information, updates information of an information-reflected visualization frame obtained by reflecting the plurality of railway information items in a visualization frame stored in advance in the memory as the visualization method for the railway information and virtual space structure data obtained by giving reference information of the information-reflected visualization frame to the main train graph, creates or updates virtual space display state data, and collectively displays the created or updated virtual space display state data on the main train graph.
That is, the display content of the plurality of railway information items is changed in real time in response to the operation of the dispatcher. Therefore, the dispatcher does not need to extract information required for instructions from a plurality of graphs or to combine the information. It is possible to reduce the burden of understanding the situation during command operations and to provide support for understanding the situation according to the level of proficiency. Therefore, the dispatcher can secure the resources to consider optimal train operations and provide train operation services that satisfy the railway users.

REFERENCE SIGNS LIST

100: Data display system
200: Railway business system
201: Operation management system
202: Vehicle management system
203: People flow information system
N1, N2: Network
500: Storage device
510: Memory
511: CPU
101: Railway business system information acquisition unit
102: Avatar operation information acquisition unit
103: Virtual space data construction unit
104: Virtual space display data creation unit
105: Display result output unit
111: Railway business system static information
112: Visualization frame
113: Information-reflected visualization frame
114: Virtual space structure data
115: Railway business system dynamic information
116: Avatar operation log
117: Virtual space display state data

Claims

A data display device for a virtual space control room that collectively displays a plurality of railway information items in a virtual space using a computer having a processor and a memory,
wherein the processor acquires the plurality of railway information items, stores the plurality of railway information items in the memory, acquires information of an avatar operation performed by a user in the virtual space, stores the avatar operation information of the user in the memory, combines visualization methods for the stored plurality of railway information items, determines a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information, and draws a virtual space display state created based on the determined data display position.
The data display device according to claim 1,
wherein the data display device is a data display device in a virtual space that collectively displays a plurality of railway information items on a main train graph in the virtual space, and

the processor combines visualization methods for railway information including a train graph in the combination and collectively displays the railway information on the main train graph in the drawing.
The data display device according to claim 2,
wherein the processor creates an information-reflected visualization frame obtained by reflecting the plurality of railway information items in a visualization frame stored in advance in the memory as the visualization method for the railway information and creates virtual space structure data obtained by giving reference information of the information-reflected visualization frame to the main train graph.
The data display device according to claim 3,
wherein the processor determines the information-reflected visualization frame to be displayed, based on the avatar operation information, creates virtual space display state data using the virtual space structure data and the information-reflected visualization frame to be displayed, and collectively displays the virtual space display state data on the main train graph.
The data display device according to claim 4,
wherein the processor reads out the railway business system dynamic information, updates information of the information-reflected visualization frame and the virtual space structure data, creates or updates the virtual space display state data, and collectively displays the created or updated virtual space display state data on the main train graph.
The data display device according to claim 5,
wherein the processor divides the main train graph into elements of an overall train graph network, a train network, a station axis, a time section axis, an edge, and a node and gives the reference information of the information-reflected visualization frame to these elements.
The data display device according to claim 5,
wherein the processor links an element having the reference information of the information-reflected visualization frame to be displayed in the main train graph to the information-reflected visualization frame to be displayed, and determines the data display position in the virtual space using a visualization rule that matches data of the main train graph and the information-reflected visualization frame to be displayed with the information-reflected visualization frame to be displayed.
The data display device according to claim 7,
wherein the processor determines the information-reflected visualization frame to be displayed, based on an error content of the railway business system dynamic information.
The data display device according to claim 8,
wherein the processor reads out at least information for touching each element in the virtual space, moving each element, moving a position of an avatar in the virtual space, and changing a line of sight in the virtual space as the avatar operation information from the memory.
The data display device according to claim 9,
wherein the processor reads out, from the memory, a comparative line train graph visualization frame indicating a comparative line that has the same departure and arrival stations and runs in parallel, and gives reference information of the comparative line train graph visualization frame to a station axis capable of transferring to the comparative line in the main train graph, and

upon receiving avatar operation information corresponding to the comparative line train graph visualization frame, the processor acquires real-time operation information, reflects the real-time operation information in the main train graph and the comparative line train graph visualization frame, generates an aspect of the comparative line train graph visualization frame in a three-dimensional direction such that a travel distance or travel time ratio between stations is matched with a length between the stations, and determine the data display position.
The data display device according to claim 9,
wherein the processor reads out a platform information visualization frame indicating platform information of a certain station from the memory and gives reference information of the platform information visualization frame to a station axis of the station and a train network running within a range of the platform information in the main train graph, and

upon acquiring avatar operation information corresponding to the platform information visualization frame, the processor acquires real-time operation information, reflects the real-time operation information in the main train graph, determines a display position of the platform information visualization frame, and changes a display position of the train network in the train graph according to a display position of a running location in the platform information visualization frame.
The data display device according to claim 11,
wherein the processor gives the reference information of the platform information visualization frame to an edge of a train stopped at the station and a train network in the platform information visualization frame in the main train graph, and

upon acquiring avatar operation information corresponding to the platform information visualization frame, the processor acquires real-time operation information, reflects the real-time operation information in the main train graph, determines the display position of the platform information visualization frame, using a stop station of a train edge operated by the avatar as a starting point, and changes a display position of a train network running before and after the train operated by the avatar according to the display position of the platform information visualization frame.
The data display device according to claim 9,
wherein the processor generates visualization frames corresponding to passenger destination information, train order constraint information, vehicle inspection information, and train operation information, and gives reference information of each of the visualization frames to nodes and edges of corresponding stations in the main train graph, and

upon acquiring avatar operation information corresponding to each of the visualization frames, the processor acquires the railway business system dynamic information, reflects the information in each of the visualization frames, and determines a display position of each of the visualization frames in the three-dimensional direction from each element of the main train graph.
A data display method for a virtual space control room that collectively displays a plurality of railway information items in a virtual space using a computer having a processor and a memory, the data display method comprising:
causing the processor to acquire the plurality of railway information items and to store the plurality of railway information items in the memory;

causing the processor to acquire information of an avatar operation performed by a user in the virtual space and to store the avatar operation information in the memory;

causing the processor to combine visualization methods for the stored plurality of railway information items;

causing the processor to determine a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information; and

causing the processor to draw a virtual space display state created based on the determined data display position.
A railway business system for collectively displaying a plurality of railway information items in a virtual space using a computer having a processor and a memory, the railway business system comprising:
a data display device that collectively displays the plurality of railway information items in the virtual space and is connected to a computer provided in a railway vehicle depot, a line including stations, or a control room in a real space via a network,

wherein the railway business system acquires the plurality of railway information items from another railway business system, stores the plurality of railway information items in the memory, acquires information of an avatar operation performed by a user in the virtual space from the computer, and stores the avatar operation information in the memory,

the computer in the railway vehicle depot and the computer in the control room access the virtual space and combine visualization methods for the stored plurality of railway information items,

the railway business system determines a data display position in a plurality of dimensions of the virtual space based on the stored avatar operation information of the user and railway business system dynamic information, and

when drawing a virtual space display state created based on the determined data display position, the railway business system reads out the railway business system dynamic information, updates information of an information-reflected visualization frame obtained by reflecting the plurality of railway information items in a visualization frame stored in advance in the memory as the visualization method for the railway information and virtual space structure data obtained by giving reference information of the information-reflected visualization frame to the main train graph, creates or updates virtual space display state data, and collectively displays the created or updated virtual space display state data on the main train graph.