JP7368284B2 - Simulation system and simulator control method - Google Patents

Description

The present disclosure relates to a simulation system and a simulator control method .

Disaster response and plant operation are tasks that can be accomplished by having many people with specialized knowledge and skills working in parallel. For example, in a situation where flood damage is likely to occur, limited human and material resources may be used in a variety of ways, such as evacuation guidance, road management (e.g., road closure), and hydraulic management (e.g., opening/closing water gates). We must allocate them and respond in a way that achieves the desired results. Patent Document 1 discloses a disaster prevention system that shares information between different disaster prevention organizations and conducts disaster prevention drills. In the disaster prevention system disclosed in Patent Document 1, a training simulator simulates a disaster situation and outputs various information regarding the disaster. The disaster prevention system provides information output by the simulator to each organization and displays it on each organization's display device. Persons participating in the training in each organization look at the information displayed on the display device, grasp the situation, and plan disaster prevention measures. By using the disaster prevention system disclosed in Patent Document 1, disaster prevention training can be conducted while sharing information. However, Patent Document 1 does not disclose that a plurality of organizations having specialized knowledge and technology train their actions until the disaster is brought under control by implementing disaster prevention measures and the like.

Regarding training for actions to bring disaster under control, for example, Patent Document 2 discloses a simulator for training operations when a disaster occurs in a plant. In the simulator disclosed in Patent Document 2, training is performed by displaying an image that simulates an operation panel in a control room of a plant on a display device, and inputting operations on the operation panel using a computer input device. In the simulator disclosed in Patent Document 2, an image of a control panel and the like are displayed on a large display device, an operator operates the control panel, and other field workers perform training using field terminals.

The simulator of Patent Document 2 is configured such that one trainee participates in training using one terminal. For example, a field worker participating in training using a field terminal may be able to see the operation panel displayed on a large display device, but an operator participating in training using a large display device may be able to see the field terminal. It is not intended that training be conducted while When participating in training using a handheld device, it is difficult to understand the operations of other trainees. In relation to such issues, Patent Document 3 discloses that a player participating in a game such as roulette provided by a computer does not input the necessary inputs to proceed with the game from the console at hand, but rather inputs information from the game table. 2. Description of the Related Art A gaming machine has been disclosed that allows players to participate in games by placing objects such as chips and medals. This gaming machine takes an image of the game table on which the object is placed, processes the captured image data, determines the position of the object on the game table and the type of the object, and uses that object. Object information indicating players and bet positions is output, and the game is controlled based on the output object information.

Japanese Patent Application Publication No. 2004-295729 Japanese Patent Application Publication No. 2019-15912 Japanese Patent Application Publication No. 2006-6912

There is a need for a simulation device that can simulate a situation close to the actual situation while allowing multiple parties to perform operations related to their own tasks in parallel and share operations performed by others.

Therefore, an object of the present invention is to provide a simulation system and a simulator control method that can solve the above-mentioned problems.

According to one aspect of the present disclosure, a simulation system includes: a first real medium; a first camera that photographs the first real medium; a first mark attached to the first real medium; a second real medium, a second camera for photographing the second real medium, a second mark attached to the second real medium, and the first real medium to which the first mark is attached. a first image taken by the first camera; and a second image taken by the second camera of the second real medium to which the second mark is attached. detecting the position and attribute of the first mark in the first real medium based on the first image; and detecting the position and attribute of the first mark in the first real medium based on the second image; an image analysis unit that detects a position and an attribute on a medium; a first image analysis unit that detects a position and an attribute of the mark based on a first image taken by the first camera; and a situation simulated by a simulator; Input data generation that generates input data and generates second input data based on the position and attribute of the landmark based on a second image taken by the second camera and the simulated situation. a simulator control device comprising: a simulator control device that obtains the first input data and the second input data from the simulator control device, and based on the obtained first input data and the second input data; , the simulator that performs a simulation that simulates the disaster situation or the situation during plant operation training that changes depending on the disaster situation and the response to the disaster, and the second image and/or the simulation result by the simulator is displayed. a first display device that displays the first image and/or a simulation result by the simulator; A first mark and the first display device are provided at a first base, and the second real medium, the second camera, the second mark, and the first display A device is provided at the second location.

According to one aspect of the present disclosure, a simulation system includes a first real medium, a first camera that photographs the first real medium, and a first image of a landmark that is projected onto the first real medium. a second projection device for projecting an image of a second landmark onto the second real medium; a second projection device for projecting an image of a second landmark onto the second real medium; a first image taken by the first camera of the first real medium on which the first mark is projected; and a first image of the second real medium on which the second mark is projected; a second image taken by a second camera; an image acquisition unit configured to detect the position and attribute of the first mark on the first real medium based on the first image; an image analysis unit that detects a position and attribute of the second mark in the second real medium based on a second image; and a position of the mark based on the first image taken by the first camera. and attributes, and a situation simulated by a simulator; a simulator control device comprising: an input data generation unit that generates second input data based on the situation; and acquiring the first input data and the second input data from the simulator control device; Based on the acquired first input data and second input data, a simulation is performed to simulate the disaster situation or the situation at the time of plant operation training, which changes depending on the disaster situation and the response to the disaster. a simulator, a first display device that displays the second image and/or a simulation result by the simulator, and a second display device that displays the first image and/or the simulation result by the simulator. The first real medium, the first camera, the first projection device, and the first display device are provided at a first base, and the second real medium; The second camera, the second projection device, and the first display device are provided at a second base.

According to one aspect of the present disclosure, a simulator control method includes providing a first real medium, a first camera, a first mark, and a first display device at a first base, a real medium, a second camera, a second mark, and a second display device are provided at a second base, and the first real medium marked with the first mark is a first image taken by the second camera, the second real medium to which the second mark is attached, a first image taken by the first camera, and a first image taken by the first camera; a second image taken by a camera; detecting the position and attribute of the first landmark in the first real medium based on the first image; detecting the position and attribute of the second landmark in the second real medium, and providing a first input based on the position and attribute of the landmark based on the first image and a situation simulated by a simulator; generating data, generating second input data based on the position and attribute of the landmark based on the second image and the simulated situation, and generating second input data based on the first input data and the second Obtain input data, and based on the obtained first input data and second input data, determine the disaster situation or the situation at the time of plant operation training, which changes depending on the disaster situation and the response to the disaster. A simulation is performed by a simulator, the second image and/or the simulation result by the simulator are output to the first display device, and the first image and/or the simulation result by the simulator is output to the second display device. This is a simulator control method that outputs to a display device .

According to one aspect of the present disclosure, a simulator control method includes providing a first real medium, a first camera, a first projection device, and a first display device at a first base; A second real medium, a second camera, a second projection device, and a second display device are provided at a second base, and the first projection device is connected to the first real medium. projecting an image of a landmark, projecting an image of a second landmark from the second projection device onto the second real medium; a first image taken by the second camera, the second real medium to which the second mark is attached, a first image taken by the first camera, and a first image taken by the first camera; a second image taken by a user, detects the position and attribute of the first mark on the first real medium based on the first image, and detects the position and attribute of the first mark on the first real medium based on the second image. detecting a position and attribute of a second landmark in the second real medium; and generating first input data based on the position and attribute of the landmark based on the first image and a situation simulated by a simulator; and generate second input data based on the position and attribute of the landmark based on the second image and the simulated situation, and generate second input data based on the first input data and the second input data. Acquire data, and simulate the disaster situation or the situation during plant operation training, which changes depending on the disaster situation and the response to the disaster, based on the acquired first input data and second input data. A simulation is performed by the simulator, the second image and/or the simulation result by the simulator is output to the first display device, and the first image and/or the simulation result by the simulator is output to the second display device. This is a simulator control method that outputs to a display device.

According to the present disclosure, it is possible to simulate a situation close to the actual situation using a general simulator.

FIG. 1 is a diagram illustrating an example of a simulation system in an embodiment of the present disclosure. FIG. 3 is a diagram illustrating input data generation processing in an embodiment of the present disclosure. FIG. 2 is a first diagram illustrating an example of simulation in an embodiment of the present disclosure. FIG. 2 is a second diagram illustrating an example of simulation in an embodiment of the present disclosure. It is a flowchart which shows an example of simulation processing by a simulation system in one embodiment of this indication. FIG. 2 is a diagram illustrating an example of a disaster situation estimation method according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating an example of analysis of simulation results in an embodiment of the present disclosure. 1 is a diagram illustrating an example of a hardware configuration of a simulator control device in an embodiment of the present disclosure.

<Embodiment>
A simulator control method according to an embodiment of the present disclosure will be described below with reference to FIGS. 1 to 8.
(System configuration)
FIG. 1 is a diagram illustrating an example of a simulation system according to an embodiment of the present disclosure. The simulation system 100 shown in FIG. 1 is a system for training behavior during disasters and predicting disasters. The simulation system 100 includes drawings such as maps 4a and 4b, a plurality of pieces 5a1 and 5b1, cameras 3a and 3b for photographing the drawings, computers 6a and 6b, projectors 8a and 8b, and cameras 3a and 3b. A simulator control device 20 that acquires a photographed image of a drawing and generates input data to a simulator 30 from the arrangement of pieces 5a1, 5b1, etc. placed in the image, and a simulator 30 that simulates a disaster situation. It consists of:

The base 1a is provided with a map 4a, pieces 5a1 to 5a5, a camera 3a, a computer 6a, and a projector 8a, and the base 1b is provided with a map 4b, pieces 5b1 to 5b3, a camera 3b, a computer 6b, and a projector 8b. There is. For example, map 4a and map 4b are the same map. The camera 3a and computer 6a, the camera 3b and computer 6b, and the simulator control device 20 are connected via a network NW. The projector 8a is connected to the computer 6a and can project the image displayed on the display section 7a of the computer 6a onto a screen (not shown) or the like. The projector 8b is connected to the computer 6b and can project an image displayed on the display section 7b of the computer 6b onto a screen (not shown) or the like. The number of maps 4a, pieces 5a1 to 5a5, cameras 3a, computers 6a, projectors 8a, etc. provided at base 1a is not limited to the number shown in FIG. For example, a plurality of cameras 3a may be provided.

The simulator control device 20 and the simulator 30 are provided at other bases 10 such as a data center or a server room. The simulator control device 20 and the simulator 30 are communicably connected. Alternatively, the simulator control device 20 may include the simulator 30.

The number of bases where the map 4a etc. are provided may be one base, or three or more bases. Each base 1a, etc. has one or more users (user 2a at base 1a, user 2b at base 1b) who participate in the simulation, and users 2a and 2b have pieces 5a1 to 5a5 on maps 4a and 4b, respectively. , 5b1 to 5b3 to participate in the simulation. Simulations are performed for training in the event of a disaster and for predicting the future when a disaster actually occurs. The camera 3a photographs the map 4a at predetermined time intervals or constantly. The photographed image A is transmitted to the simulator control device 20. The camera 3b photographs the map 4b at predetermined time intervals or constantly. The photographed image B is transmitted to the simulator control device 20. The image A taken by the camera 3a may be transmitted to the computer 6b of the base 1b and displayed on the display section 7b. The image B taken by the camera 3b may be transmitted to the computer 6a of the base 1a and displayed on the display section 7a. Alternatively, the simulator control device 20 may create an image by combining image A and image B, and send this image to the computers 6a and 6b. As a result, the user 2a can check the placement of the pieces 5b1 etc. placed on the map 4b of the base 1b, and the user 2b can check the placement of the pieces 5a1 etc. placed on the map 4a of the base 1a. I can do it. The computers 6a and 6b transmit instruction information for instructing the start and end of the simulation to the simulator control device 20, acquire simulation result information from the simulator control device 20, and display it on the display units 7a and 7b. do.

The simulator control device 20 analyzes the positions where the pieces 5a1 etc. are placed and the colors of the pieces 5a1 etc. from the images A and B taken by the cameras 3a and 3b, and converts this into input data to be given to the simulator 30. The pieces 5a1 to 5a5 and the pieces 5b1 to 5b3 have, for example, a coin shape, and have different colors on the front and back sides. For example, the front surfaces of the pieces 5a1 to 5a5 at the base 1a are black, and the back surfaces are white. The front faces of the pieces 5b1 to 5b3 of base 1b are red, and the back faces are blue. Pieces 5a1 and the like have different meanings depending on the position placed on the map, the color, and the type and situation of the simulated disaster. In other words, placing a piece 5a1 etc. in any position on the map 4a with the front or back side facing up means a specific action in response to a disaster, and depending on the position and color of the piece 5a1 etc. The simulator 30 simulates the following disaster situation. One piece 5a1 etc. represents one or more people or things. For example, piece 5a1 is set in advance to represent one police vehicle and two police officers. Further, different meanings and roles are assigned to the front and back sides of the pieces 5a1 and the like. For example, the front side means rescuing people or guiding evacuations, and the back side means dealing with disasters, such as extinguishing fires. This shows that police officers, firefighters, etc. can play multiple roles, but it also shows that they can only play one role at a time. Further, the number of pieces 5a1 etc. indicates the quantity of resources. This means that there is a limit to the number of people and vehicles that can operate during a disaster. The users 2a and 2b arrange a limited number of pieces 5a1, etc. on the map 4a to respond to disasters.

The simulator control device 20 includes an image acquisition section 21, an image analysis section 22, a storage section 23, a data transmission/reception section 24, an input data generation section 25, a result output section 26, and an analysis section 27. There is.
The image acquisition unit 21 acquires an image A of the map 4a taken by the camera 3a and an image B of the map 4b taken by the camera 3b.
The image analysis unit 22 detects the position and attributes (color, shape, material, etc.) of the piece 5a1 etc. included in each of the images A and B taken by the cameras 3a and 3b. The image analysis section 22 outputs the position and attributes of the piece 5a1 etc. detected based on each image to the input data generation section 25.
The storage unit 23 stores images A and B acquired by the image acquisition unit 21, simulation results acquired from the simulator 30, and the like.
The data transmitting/receiving unit 24 receives instruction information transmitted by the computers 6a, 6b, and transmits simulation results to the computers 6a, 6b.
The input data generation unit 25 generates input data to be input to the simulator 30 based on the position and attributes of the pieces 5a1 and the like, and the disaster situation simulated by the simulator 30. The simulator 30 acquires the input data generated by the input data generation unit 25 and simulates the following situation.
The result output unit 26 acquires and outputs the results of the simulation performed by the simulator 30 by acquiring input data.
The analysis unit 27 analyzes the simulation results.

The simulator 30 simulates the situation and damage caused by a disaster such as a fire or flood. For example, in the case of a fire, the area of influence and force of the fire is simulated, the number of houses and people affected by the fire are calculated, and this information is output to the simulator control device 20 as a simulation result. The simulator 30 does not need to be anything special, and may be a conventionally available simulator.

(Generation of input data)
FIG. 2 is a diagram illustrating input data generation processing in an embodiment of the present disclosure.
With reference to FIG. 2, a process for generating input data to the simulator 30 in accordance with the position, color, and disaster situation of the piece 5a1 etc. will be described. As an example, it is assumed that the pieces 5a1 to 5a5 at the base 1a have black front faces and white back faces, and the pieces 5b1 to 5b3 at base 1b have red front faces and blue back faces. For example, at base 1a, user 2a trains police officers on how to behave in a disaster, and at base 1b, user 2b trains fire fighters on how to behave in a disaster. The storage unit 23 records a correspondence table in which input data corresponding to the color of the piece 5a1, etc., the position where the piece 5a1, etc. is placed, and the type of disaster to be simulated, as illustrated in FIG. 2, is recorded. There is. Further, for example, the pieces 5a1 to 5a5 may each represent one police vehicle and two police officers, and the storage unit 23 may register the correspondence between the resources of each organization and the pieces.

(Example of generating input data regarding police officer behavior)
For example, if the type of disaster is a fire, if the user 2a places the piece 5a1 with the back side (white) facing upward near the fire site on the map 4a, this means that a police officer will guide evacuation or control traffic. However, the input data generation unit 25 generates input data indicating, for example, "positioning of police officers." For example, when this input data is input to the simulator 30 together with the information on the placement position of the piece 5a1, the simulator 30 simulates that vehicles and pedestrians can pass without confusion on the road where the police officer is placed, and the user 2a If input data indicating the "deployment of police officers" is not input because the police officers are not placed in appropriate positions, traffic will be confused on roads where police officers are not placed, simulating the result of traffic congestion and secondary disasters.

For example, if the type of disaster is a river flood, if the user 2a places the piece 5a1 with the surface (black) facing upward near the flood site on the map 4a, a police officer will observe the situation and report it to the disaster control headquarters. The input data generation unit 25 generates input data indicating a "situation report." For example, if this input data is input to the simulator 30 along with the information on the placement position of the piece 5a1, the simulator 30 will present the scale and situation of the flood to the user side, and if input data indicating a report is not input, the simulator 30 will display the scale and situation of the flood. Do not present the situation to the user. If the scale and situation of flooding are not presented, the users 2a and 2b undergoing training will have to take subsequent actions without knowing the scale and situation of flooding.

For example, if the type of disaster is a river flood, if the user 2a places the piece 5a1 with the back side (white) facing upward and places it in a place other than the site where the flood occurred on the map 4a, it will be used by police officers, residents, etc. The input data generation unit 25 generates input data that means "deployment of police officers". For example, when this input data is input to the simulator 30 together with the information on the placement position of the piece 5a1, the simulator 30 simulates that vehicles and pedestrians can pass without confusion on the road where police officers are placed, If no input data indicating ” is entered, a situation in which people or vehicles are caught in a river flood will be simulated.

(Example of generating input data regarding firefighter actions)
For example, if the type of disaster is a fire, if the user 2b places the piece 5b1 with the front side (red) facing upward on the map 4b near the site of the fire, it will indicate that the firefighter will be able to extinguish the fire. The input data generation unit 25 generates input data that means "start of firefighting activities." For example, when this input data is input to the simulator 30 together with the information on the placement position of the piece 5b1, the simulator 30 simulates that the firefighting operation is started from the time when the piece 5b1 is placed. For example, if firefighting activities are started early, the fire will be extinguished before it spreads, and if firefighting activities are delayed, the fire will be extinguished after the fire has spread. Furthermore, the effectiveness of firefighting activities differs depending on the number of pieces 5b1 etc. placed. For example, when the user 2b places the piece 5b1 with the front side (red) facing upward near the fire scene, the input data generation unit 25 generates "start of firefighting" and "intensity=1", and the pieces 5b1, 5b2 When placed near the fire scene, the input data generation unit 25 generates "start of firefighting" and "intensity=2". The simulator 30 performs a simulation such that the fire is extinguished more quickly when the intensity is 2. If the user 2b does not place the piece 5b1 or the like near the scene and input data indicating "start of firefighting activities" is not input, the simulator 30 simulates a situation in which the damage from the fire increases.

For example, if the type of disaster is a fire, if the user 2b places the piece 5b1 with the back side (blue) facing upwards on the map 4b near the site where the fire occurred, this means that firefighters will carry out rescue operations. However, the input data generation unit 25 generates input data that means "start of rescue." For example, when this input data is input to the simulator 30 together with information on the placement position of the piece 5b1, the simulator 30 simulates that the rescue is started from the time when the piece 5b1 is placed. For example, the simulator 30 calculates the number of people rescued and the success rate according to the rescue start time. The earlier the rescue starts, the more people will be rescued. Further, the number of people who can be rescued differs depending on the number of pieces placed such as the pieces 5b1. For example, when the user 2b places the piece 5b1 with the back side (blue) facing upward near the fire scene, the input data generation unit 25 generates "start of rescue" and "intensity = 1", and sets the pieces 5b1 and 5b2. When placed near the fire scene, the input data generation unit 25 generates "start of rescue" and "intensity=2". When "strength=2" is input, the simulator 30 performs a simulation so that more rescuers come out. If input data indicating "start of rescue" is not input, for example, the simulator 30 calculates the number of victims of the fire in the absence of rescue.

Here, for example, if there are a large number of pieces 5b1 etc. placed with their backs (blue) facing upwards and few pieces 5b1 etc. placed with their front side (red) facing upwards, a situation may arise where the fire extinguishing is not sufficient and the number of victims increases. obtain. The user 2b needs to consider the number of pieces allocated to fire extinguishing and rescue and the timing of placing them.

For example, if the type of disaster is a river flood, if the user 2b places the piece 5b1 with the front side (red) facing upward and places it on the map 4b near the site where the flood occurred, the firefighter will be able to load sandbags. The input data generation unit 25 generates input data that means "start of sandbag work." For example, when this input data is input to the simulator 30 together with information on the placement position of the piece 5b1, the simulator 30 simulates that the work of stacking sandbags is started from the time when the piece 5b1 is placed. For example, if work starts early, the area affected by flooding will be smaller; if work is delayed, the area affected will expand. Further, the effect of the work differs depending on the number of pieces placed such as the pieces 5b1. For example, when the user 2b places the piece 5b1 with the surface (red) facing upward near the flood site, the input data generation unit 25 generates "start of sandbag work" and "strength=1", and the pieces 5b1, 5b2 When placed near the flood site, the input data generation unit 25 generates "start of sandbag work" and "intensity=2". When "intensity=2" is input, the simulator 30 performs a simulation so that the flooding subsides more quickly. If input data indicating "start of sandbag work" is not input, the simulator 30 simulates a situation where the range of influence of flooding expands.

For example, if the type of disaster is a river flood, if the user 2b places the piece 5b1 with the back side (blue) facing upward and places it near the site where the flood occurred on the map 4b, it will be used by firefighters to rescue residents. The input data generation unit 25 generates input data that means "start of rescue". For example, when this input data is input to the simulator 30 together with the information on the placement position of the piece 5b1, the simulator 30 simulates that the rescue is started from the time when the firefighter is placed. For example, the simulator 30 calculates the number of people who were able to be rescued and the success rate according to the rescue start time. The earlier the rescue starts, the more people will be rescued. Further, the number of people who can be rescued differs depending on the number of pieces placed such as the pieces 5b1. For example, when the user 2b places the piece 5b1 with the back side (blue) facing upward near the fire scene, the input data generation unit 25 generates "start of rescue" and "intensity = 1", and sets the pieces 5b1 and 5b2. When placed near the fire scene, the input data generation unit 25 generates "start of rescue" and "intensity=2". If input data indicating "start of rescue" is not input, for example, the simulator 30 calculates the number of victims of the fire in the absence of rescue.

If there are a large number of pieces 5b1, etc. placed with their backs (blue) facing upwards, and few pieces 5b1, etc. placed with their front sides (red) facing upwards, a situation may arise in which flooding cannot be suppressed and the number of victims increases. The user 2b needs to consider the number of pieces allocated to the work of loading sandbags and rescue, and the timing of placement.

Furthermore, even the same type of disaster and the same color may be given different roles depending on the progress of the disaster. For example, if an accident occurs at a nuclear power generation facility, those involved will respond to the accident within the facility up to a certain phase (Phase 1), but after Phase 1, they will go outside the facility and Conducts evacuation support activities and support activities for evacuation center management. In such a case, if the phase of the disaster indicated by the latest simulation result by the simulator 30 is before phase 1, the input data generation unit 25 may generate, for example, " If the phase of the disaster indicated by the simulation result is after phase 1, input data meaning "accident response" is generated.

(Example of action: fire)
Next, the operation of the simulation system 100 will be explained using the case of a fire as an example.
FIG. 3 is a first diagram illustrating an example of simulation in an embodiment of the present disclosure.
FIG. 3(a) shows maps 4a and 4b before simulation. Before the simulation, users 2a and 2b are notified that a fire has broken out at a certain location. In FIG. 3A and the like, a flame mark 300 is displayed at the location where the fire occurred. Starting from the state shown in FIG. 3(a), the users 2a and 2b perform a simulation until the fire is extinguished. For example, in the base 1a, the user 2a places pieces 5a1 and 5a2 on two roads 301 and 302 facing the place where the fire occurred on the map 4a, respectively. Pieces 5a1 and 5a2 are both placed with their backs (white) facing up. The map 4a after placing the pieces 5a1 etc. is shown in FIG. 3(c). The camera 3a photographs an image A of the map 4a illustrated in FIG. 3(c), and transmits it to the simulator control device 20.

At base 1b, user 2b places pieces 5b1 and 5b2 on two roads 301 and 302 facing the place where the fire occurred on map 4b, respectively. The user 2b places the piece 5b1 with its front side (red) facing upward, and places the piece 5b2 with its back side (blue) facing upward. The map 4b after placing the pieces 5b1 and 5b2 is shown in FIG. 3(b). The camera 3b photographs an image B of the map 4b illustrated in FIG. 3(b), and transmits it to the simulator control device 20.

In the simulator control device 20, the image analysis unit 22 analyzes the image A taken by the camera 3a and recognizes that the pieces 5a1 and 5a2 have been placed on the roads 301 and 302 facing the fire scene. Further, the image analysis unit 22 recognizes the color (white) of the pieces 5a1 and 5a2. The image analysis unit 22 analyzes the image B taken by the camera 3b and recognizes that the pieces 5b1 and 5b2 are placed on the road facing the fire scene. The image analysis unit 22 also recognizes that the color of the piece 5b1 is red and the color of the piece 5b2 is blue.

The input data generation unit 25 generates input data to be input to the simulator 30 from the analysis result of the image analysis unit 22. For example, the input data generation unit 25 generates input data 1 indicating that the disaster is a fire and the piece 5a1 is placed on the road 301, so that a police officer is to be placed on the road 301, and the piece 5a2 is placed on the road 301. Since the piece 5b1 is placed on the road 302, input data 2 is generated indicating that a police officer is to be placed on the road 302, and input data 3 is generated indicating that the piece 5b1 is placed on the road 301 and its color indicates the start of fire extinguishing operations. , and from the fact that the piece 5b2 is placed on the road 302 and its color, input data 4 indicating the start of rescue is generated. The input data generation unit 25 inputs input data 1 to 4 to the simulator 30.

The simulator 30 is given map data for the same locations as the maps 4a and 4b, and is initially set to indicate that a fire occurred at the same location as the illustrated mark 300. For example, the simulator 30 is designed to perform an operation that simulates a fire state by advancing the fire state to the next stage at predetermined time intervals after a fire has occurred. If the users 2a, 2b do not place the pieces 5a1, etc. in appropriate positions during this predetermined time, the fire will progress, and if they can place the pieces 5a1, etc. in appropriate positions, the situation can be brought under control. For example, each time the fire status advances to the next stage, the simulator 30 calculates the total damage cost up to that point based on the number of houses damaged by the fire. The simulation by the simulation system 100 is executed, for example, with the goal of reducing this damage cost as much as possible. When the input data generation unit 25 inputs the input data 1 to 4 to the simulator 30, the simulator 30 gives the input data 1 to 4 to the latest simulated state and calculates the next stage of the fire situation and the damage so far. Calculate cumulative costs, etc. For example, when the input data 3 simulates that the fire is extinguished, the simulator 30 ends the simulation and calculates, for example, the time it took to extinguish the fire, the total damage cost, the number of rescuers, the resources invested, etc. The simulation result is output to the simulator control device 20. The result output unit 26 acquires the simulation results and transmits them to the computers 6a and 6b. Computers 6a and 6b output simulation results. FIG. 3(d) shows an example of the simulation results displayed on the display sections 7a and 7b.

In addition, at the time of starting the simulation, the simulator 30 outputs a simulation result such as "a fire broke out in the XX area", and this information is displayed on the display units 7a and 7b. Based on this display, the users 2a and 2b begin responding to the fire by placing pieces 5a1 and the like on the map 4a and the like. In addition, when a predetermined period of time has passed since the fire broke out, and the simulator 30 simulates the next stage of the fire, for example, "fire is spreading, XX minutes have passed since the fire started, damage cost is X yen", etc. The simulation results are displayed on display sections 7a and 7b. The users 2a and 2b respond to the fire based on this display, and repeat the same procedure until the fire is extinguished.

(Example of action: River flooding)
Next, the operation of the simulation system 100 will be explained using the case of river flooding as an example.
FIG. 4 is a second diagram illustrating an example of simulation in an embodiment of the present disclosure.
FIG. 4(a) shows maps 4a and 4b before simulation. Before the simulation, the users 2a and 2b are notified that flooding has occurred at the location marked with an x mark 401 on the river 400. The simulator 30 is given map data for the same locations as the maps 4a and 4b, and is initially set to indicate that flooding has occurred at the same location as the illustrated mark 401. The simulator 30 advances and simulates the range of influence of flooding to the next stage at predetermined time intervals after the occurrence of flooding.

Starting from the state shown in FIG. 4A, a simulation is performed until the users 2a and 2b complete response to the flooding (for example, stopping the expansion of the flooding and evacuating nearby residents). For example, in the base 1a, the user 2a places a piece 5a1 near the place marked with the mark 401 on the map 4a with the front side (black) facing upward, and places a piece 5a2 away from the river 400 with the back side (white) facing upward. Place it facing up. The map 4a after placing the pieces 5a1 etc. is shown in FIG. 4(c). The camera 3a photographs an image A of a map 4a illustrated in FIG. 4(c), and transmits it to the simulator control device 20.

At the base 1b, the user 2b places a piece 5b1 with the front side (red) facing upward near the position marked with the mark 401 on the map 4b, and places the piece 5b1 with the back side (blue) facing upward near the position marked with the mark 401. and place piece 5b2. The map 4a after placing the pieces 5b1 etc. is shown in FIG. 4(b). The camera 3b photographs an image B of the map 4b illustrated in FIG. 4(b), and transmits it to the simulator control device 20.

In the simulator control device 20, the image analysis unit 22 analyzes the image taken by the camera 3a and recognizes the positions where the pieces 5a1 and 5a2 are placed and the colors of the pieces 5a1 and 5a2. The image analysis unit 22 analyzes the image taken by the camera 3b and recognizes the positions and colors of the pieces 5b1 and 5b2.

The input data generation unit 25 generates input data to be input to the simulator 30 based on the analysis result of the image analysis unit 22 and the type of disaster being a river flood. For example, the input data generation unit 25 generates input data 5 indicating a situation report based on the position and color of the piece 5a1, and generates input data 6 indicating the arrangement of police officers based on the position and color of the piece 5a2. Then, input data 7 indicating the start of sandbag work is generated based on the position and color of the piece 5b1, and input data 8 indicating the start of rescue is generated based on the position and color of the piece 5b2. The input data generation unit 25 inputs input data 5 to 8 to the simulator 30.

When the simulator 30 acquires the input data 5 to 8, it applies the input data 5 to 8 to the latest simulated state, and calculates the next stage of the flood damage situation and the cumulative damage cost so far. For example, when the input data 5 to 8 simulate a situation in which the spread of flooding has stopped and the evacuation of surrounding residents has been completed, the simulator 30 ends the simulation and calculates the time taken to complete the response, the damage caused, etc. The simulation results, such as the total cost, the number of rescuers, and the input resources, are output to the simulator control device 20. FIG. 4(d) shows an example of the simulation results displayed on the display sections 7a and 7b.

The simulation by the simulation system 100 illustrated using FIGS. 3 and 4 can be used for the purpose of training for disaster response. Furthermore, when a disaster actually occurs, it can be used for the purpose of determining what kind of response should be taken in the future. For example, the simulator 30 simulates the current disaster situation and repeats the simulation. Then, a response that yields the most desirable simulation result is selected and executed.

(Flow of simulation processing)
Next, the flow of simulation processing by the simulation system 100 will be explained.
FIG. 5 is a flowchart illustrating an example of processing in an embodiment of the present disclosure.
First, the person responsible for executing the simulation makes initial settings for the simulation situation. For example, when the simulation system 100 is used for training, a disaster to be trained is assumed and its contents are set in the simulator 30. The information set in the simulator 30 varies in the simulator 30. The executive person sets, for example, map data including the training target location, disaster type, occurrence location, scale, occurrence probability, etc. in the simulator 30. The simulator 30 acquires the set information and performs initial settings for the simulation (step S11). Furthermore, when a simulation is used to predict the progress of a disaster in a situation where a disaster actually occurs, the person in charge of execution compiles the reported disaster situation and estimates the disaster situation. Reference is now made to FIG.

FIG. 6 is a diagram illustrating an example of a disaster situation estimation method according to an embodiment of the present disclosure.
FIG. 6 shows a map 600 of the area where the disaster occurred. An area 601 surrounded by a frame line is an area predicted in advance to have a high risk of disaster based on a hazard map or the like. If the occurrence of a disaster is currently being reported from District A and District D, the person in charge of execution may, for example, say that a disaster has occurred in Area 601, which has a high risk of disaster, and that the report from District B has been omitted for some reason. It is estimated that Furthermore, if the occurrence of a disaster has been reported from District A, District D, and District C, the executive officer estimates that the disaster has occurred in a wide area of Districts A to D, for example. The administrator sets necessary information in the simulator 30 so that the estimated disaster situation can be simulated.

Next, the user 2a performs an operation to instruct the computer 6a to start the simulation. The computer 6a transmits information instructing the start of simulation to the simulator control device 20. In the simulator control device 20, the data transmitter/receiver 24 acquires this information and instructs the simulator 30 to start simulation. The simulator 30 starts simulation (step S12).

When the simulation is started, the simulator 30 outputs the simulation result (for example, the contents of the initial settings at the first time) to the simulator control device 20. In the simulator control device 20, the result output unit 26 acquires the simulation results and transmits this information to the computers 6a and 6b. Computers 6a and 6b display the simulation results received from simulator control device 20 on display units 7a and 7b, respectively. The display units 7a and 7b display simulation results such as "a fire broke out in XX", for example.

In response to this display, the user 2a considers how to respond to disasters and places the pieces 5a1 and the like at appropriate positions on the map 4a, with the appropriately colored sides facing upward. The same applies to user 2b. The camera 3a transmits an image A of the map 4a to the simulator control device 20. The camera 3b transmits an image B of the map 4b to the simulator control device 20.

In the simulator control device 20, the image acquisition unit 21 acquires image A and image B (step S13). The image acquisition unit 21 stores image A and image B in the storage unit 23. The image analysis unit 22 analyzes the image A and detects the position where the piece 5a1 etc. are placed (for example, the coordinate information of the piece 5a1 when a predetermined position on the map 4a is set as the origin). Further, the image analysis unit 22 analyzes the image A and detects the color of the top surface of the piece 5a1. Further, for example, the image analysis unit 22 may detect the shape or material of the piece 5a1 instead of (or in addition to) the color of the piece 5a1. Regarding material detection, the image analysis unit 22 detects the material using image characteristics based on the reflectance of each material. Note that when detecting the shape or material of the piece 5a1, input data is set in advance for each position where the piece 5a1 is placed and the shape or material of the piece 5a1. For example, when generating input data using the color and material of piece 5a1, the color determines the role (for example, whether to carry out firefighting or rescue operations), and the material determines the scale (number of firefighters or fire truck). (number of units) may be determined. The image analysis unit 22 detects the position and color of the piece 5b1 etc. based on the image B. The image analysis section 22 outputs the position and color of each piece 5a1 etc. to the input data generation section 25.

Next, the input data generation unit 25 generates input data (step S14). The input data generation unit 25 generates, for example, the position and color of each frame acquired from the image analysis unit 22, the type and situation (phase) of the disaster included in the latest simulation results acquired last time by the result output unit 26, and the diagram. Input data is generated for each piece 5a1 etc. based on the correspondence table exemplified in FIG. The input data generation unit 25 inputs the generated input data to the simulator 30. The simulator 30 acquires input data and executes a simulation (step S15), and simulates the next situation. The simulator 30 outputs the simulation results to the simulator control device 20. The simulation results include the latest disaster situation (for example, future predictions such as the extent of the fire and whether it is expanding or converging), the total damage cost so far, the number of rescuers, information on the resources invested, etc. included. The result output unit 26 records the simulation results obtained from the simulator 30 in the storage unit 23. Further, the result output unit 26 acquires the input data generated in step S14 from the input data generation unit 25, and records it in the storage unit 23 in association with the simulation result. Further, the result output unit 26 transmits the simulation results to the computers 6a and 6b. The computers 6a and 6b display the simulation results (step S16). The users 2a and 2b, while viewing the simulation results, place another piece 5a2, etc. at a new appropriate position on the map 4a, or move the piece 5a1 to an appropriate position.

Next, the simulator 30 determines whether to end the simulation (step S17). For example, when information instructing to end the simulation is transmitted from the computer 6a or the like, the simulator 30 determines to end the simulation. Alternatively, when the response to the disaster is completed, the simulator 30 determines to end the simulation. When terminating the simulation, the processing in FIG. 5 is terminated.
If the simulation does not end, the simulation system 100 repeatedly executes the processing from step S13.

The users 2a and 2b repeatedly participate in the simulation according to the process shown in FIG. 5 until the desired simulation result is obtained. During training, the users 2a and 2b learn appropriate responses when a disaster occurs, and when a disaster occurs, they learn various responses. Select an appropriate response from among the candidate methods.

In addition, in the above description, the map 4a and the map 4b were explained as being the same map, but they may be maps of completely different locations. For example, when performing a simulation of a situation in which a disaster has occurred in a plurality of locations, each base 1a, 1b prepares a map specialized for the area in charge and performs the simulation. The storage unit 23 records the range shown by the map 4a and the range shown by the map 4b, and the image analysis unit 22 calculates the position where the piece 5a1 etc. is placed within the range shown by the map 4a based on the image A. Then, based on the image B, the position where the piece 5b1 etc. are placed is specified from within the range indicated by the map 4b. In addition, the input data generation unit 25 generates input data according to the specified position, etc., and inputs it to the simulator 30. The simulator 30 simulates the situation of a disaster occurring in the range shown by each of the maps 4a and 4b.

FIG. 7 is a diagram illustrating an example of analysis of simulation results in an embodiment of the present disclosure. When the users 2a and 2b repeatedly participate in the simulation, the storage unit 23 records simulation results when various responses to the same disaster are taken. Based on these records, the analysis unit 27 creates, for example, a graph showing the speed of damage expansion illustrated in FIG. 7(a). The vertical axis of the graph in FIG. 7(a) represents the magnitude of damage, and the horizontal axis represents time. The time on the horizontal axis is the elapsed time from the occurrence of the disaster simulated by the simulator 30 during the simulation. The analysis unit 27 reads out the damage cost calculated each time the simulator 30 executes a simulation, and creates a graph shown in FIG. 7(a). Furthermore, the analysis unit 27 reads the number of rescuers calculated each time the simulator 30 executes a simulation from the storage unit 23, and creates a graph showing changes in the remaining rescuers as illustrated in FIG. 7(b). The vertical axis of the graph in FIG. 7(b) represents the number of remaining rescuers, and the horizontal axis represents time.
The graph 61 in FIG. 7(a) and the graph 64 in FIG. 7(b) are graphs created based on simulation results recorded during the same simulation execution. Similarly, graphs 62 and 65, and graphs 63 and 66 are graphs created based on results recorded during the same simulation execution. The person in charge of executing the simulation refers to FIGS. 7(a) and 7(b) and determines that the correspondence in the simulation in which graphs 63 and 66 are obtained is optimal. Since the input data in the simulation determined to be optimal is recorded in the storage unit 23, the users 2a and 2b can learn and execute the optimal response based on this record. The simulator control device 20 also receives information specifying a simulation determined to be optimal (simulation ID number, etc.), reads images A and B taken during execution of the simulation from the storage unit 23, and sends them to the user. It may also have the function of presenting.

As described above, according to the simulation system 100 of the present embodiment, it is possible to simulate a job in which a plurality of people engaged in different jobs can achieve their goals by working concurrently, and the simulation , each of the users 2a and 2b, who are engaged in different jobs, can participate in the simulation simply by inputting information regarding the work they are responsible for. Furthermore, input to the simulator 30 becomes possible by placing the piece 5a1 etc. on the map 4a. Therefore, for example, a plurality of users engaged in different jobs can share one map 4a and place pieces 5a1, etc. associated with their jobs on the map, so that they can understand their own and others' effects on the simulated situation. Be able to understand behavior. As a result, each person participating in the simulation can participate in the simulation while understanding the actions of themselves and others and changes in the situation due to those actions (simulation results of the simulator 30). As a result, the content and results of the simulation can be felt by the user.

In addition, since it is not easy for people engaged in different jobs to gather in the same place, similar maps 4a and 4b are provided at different bases 1a and 1b, as illustrated in FIG. By being able to refer to the state of 4b, it is possible to participate in the simulation while grasping the actions of oneself and others, including users at other bases. This allows users located in remote locations to participate in the simulation while sharing their consciousness.

In addition, the number of pieces such as 5a1 is limited, and their role is limited depending on whether they are placed with either the front or back facing upwards, so it is necessary to invest resources that have roles depending on the situation, and Since the pieces 5a1 and the like are arranged while taking into consideration the fact that there is a limit to the amount of available resources, a simulation that is in line with the actual situation becomes possible. For example, the simulation system 100 allows the user to understand that desired results cannot be obtained unless the balance between personnel assigned to rescue and personnel performing actions to contain a disaster is well balanced.

Further, since input data can be arbitrarily set according to the position and color of the pieces, the type and situation of the disaster, the present invention can be applied to any simulator 30.

In the above embodiment, the piece 5a1 is coin-shaped, but the piece 5a1 etc. may be a polyhedron, a cylinder, a cone, a humanoid, an animal or a plant, or a character-shaped object. Further, for example, although the attribute of the piece 5a1 is determined by the color or the like, the input data may be set depending on the direction in which the piece 5a1 etc. are placed. For example, if the piece 5a1 etc. has an arrow shape when viewed from above, different roles/functions such as "reporting the situation", "rescue", "traffic regulation", etc. may be set depending on the direction the arrow faces. Alternatively, the piece 5a1 is a colored sticky note, and the characters written on the sticky note are read using OCR etc., and the color of the sticky note and the position where the sticky note is pasted are input according to the read content. May also generate data.

Furthermore, the pieces may be images projected by projection mapping. For example, in FIG. 1, projectors 8a and 8b are directed toward maps 4a and 4b, respectively. The image analysis unit 22 analyzes the positions and colors of the pieces 5b1 and the like based on the image B transmitted from the base 1b. The data transmitting/receiving unit 24 transmits this analysis result to the computer 6a at the base 1a. The computer 6a uses the projector 8a to project an image showing the piece 5b1 to the corresponding position on the map 4a based on the position and color of the piece 5b1 etc. included in the analysis result. For example, if the piece 5b1 is placed at a position α on the map 4b with the back side (blue) facing upward, the projector 8a projects a blue image at a position corresponding to the position α on the map 4a. The camera 3a photographs the map 4a including the projected image of the piece 5a1, etc., and transmits the image A to the simulator control device 20. In the simulator control device 20, the image analysis unit 22 detects the position and color of the piece 5a1 etc. and the projected image. The input data generation unit 25 generates input data based on the piece 5 a 1 etc. and input data based on the projected image, and inputs them to the simulator 30 . Similarly, at the base 1b, an image based on the piece 5a1 etc. placed on the map 4a at the base 1a is projected onto the map 4b via the projector 8b. With such a method, the user 2a at the base 1a can grasp the position and color of the piece 5b1 etc. placed on the map 4b at the base 1b. Similarly, the user 2b at the base 1b can grasp the position and color of the piece 5a1 etc. placed on the map 4a at the base 1a.

Further, in the above embodiment, an example is given in which the maps 4a and 4b are used as drawings, but for example, drawings may include piping diagrams, system charts, organizational charts, network diagrams (not limited to communication networks, but also information on supply chains, etc.). ), circuit diagrams, wiring diagrams, structural diagrams of buildings, process diagrams, hazard maps, various tables, etc. For example, when a piping diagram is used, it is possible to simulate a situation where a problem occurs somewhere in the piping, and conduct training for dealing with the problem when it occurs. Further, the drawing may be handwritten on a whiteboard or the like, or may be projected onto a whiteboard or the like using a projector 8a or the like, or may be displayed on a display device.

Further, in the above embodiment, communication between the computers 6a and 6b and the simulator 30 is performed via the simulator control device 20, but if the simulator 30 is equipped with a communication interface, the simulator control device 20 It may be configured to provide only functions related to input data generation. In this case, for example, the simulator control device 20 includes an image acquisition section 21, an image analysis section 22, a storage section 23, and an input data generation section 25.

Further, although the above embodiment has been described using an example of simulating a disaster, the simulation system 100 can be used not only for disaster response but also for plant operation training and the like.

FIG. 8 is a diagram illustrating an example of the hardware configuration of a simulator control device in an embodiment of the present disclosure.
The computer 900 includes a CPU 901, a main storage device 902, an auxiliary storage device 903, an input/output interface 904, and a communication interface 905.
The above-described simulator control device 20 is implemented in a computer 900. The above-mentioned functions (image acquisition section 21, image analysis section 22, data transmission/reception section 24, input data generation section 25, result output section 26, analysis section 27) are stored in the auxiliary storage device 903 in the form of a program. ing. The CPU 901 reads the program from the auxiliary storage device 903, expands it to the main storage device 902, and executes the above processing according to the program. Further, the CPU 901 reserves a storage area in the main storage device 902 according to the program. Further, the CPU 901 secures a storage area in the auxiliary storage device 903 to store the data being processed according to the program.

A program for realizing all or part of the functions of the simulator control device 20 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed, thereby achieving each function. Processing may also be performed by the department. Note that the "computer system" herein includes hardware such as an OS and peripheral devices. Furthermore, the term "computer system" includes the homepage providing environment (or display environment) if a WWW system is used. Furthermore, the term "computer-readable recording medium" refers to portable media such as CDs, DVDs, and USBs, and storage devices such as hard disks built into computer systems. Further, when this program is distributed to the computer 900 via a communication line, the computer 900 that received the distribution may develop the program in the main storage device 902 and execute the above processing. Further, the above program may be one for realizing a part of the above-mentioned functions, and further may be one that can realize the above-mentioned functions in combination with a program already recorded in the computer system. .
Further, the simulator control device 20 may be configured by a plurality of computers 900. The storage unit 23 may be stored in an external storage device separate from the computer 900.

In addition, it is possible to appropriately replace the components in the above-described embodiments with well-known components without departing from the spirit of the present invention. Further, the technical scope of the present invention is not limited to the above-described embodiments, and various changes can be made without departing from the spirit of the present invention.

<Additional notes>
The simulator control device 20, simulation system 100, simulator control method, and program described in each embodiment are understood as follows, for example.

(1) The simulator control device 20 according to the first aspect includes an image acquisition unit 21 that acquires an image of a real medium (such as a map 4a) on which a mark (such as a piece 5a1) is attached, and a An image analysis unit 22 that detects the position and attributes of the landmark on the real medium, and a situation simulated by the simulator 30 (disaster type and phase), the position, and the attribute, the simulator and an input data generation section 25 that generates input data to be input.
This makes it possible for multiple users to participate in the simulation at the same time by marking them on real media (whiteboards displaying drawings, tables, diagrams, blackboards, screens, display devices, etc.). This makes it easier. Furthermore, it is possible to participate in the simulation while sharing operations performed by other users (placing marks). For example, users with different roles can proceed with the simulation while looking at the same drawing while referring to the actions of other users (by marking them) and the simulation results of their own and others' actions. can participate in the simulation.

(2) The simulator control device 20 according to the second aspect is the simulator control device 20 of (1), in which the input data generation unit 25 performs the following based on any of the color, shape, and material of the mark: Generate the input data.

(3) The simulator control device 20 according to a third aspect is the simulator control device 20 of (1) to (2), in which the input data generation unit is attached to the same position based on the attribute of the landmark. selectively determining one of the input data regarding the landmarks that have been identified.
This makes it possible to assign multiple roles and functions to one landmark, and then allow only one of them to perform. This allows the simulation to be executed with the restriction that one person can only do one job at a time.

(4) The simulator control device 20 according to the fourth aspect is the simulator control device 20 of (1) to (3), and the real medium includes a map, a piping diagram, a system diagram, a network diagram, and a circuit diagram. , wiring diagram, structure diagram, organization chart, process diagram, hazard map, or table is displayed.

(5) The simulation system 100 according to the fifth aspect includes a real medium (such as a map 4a), one or more cameras 3a, etc. that photograph the real medium, and the mark (piece 5a1) attached to the real medium. etc.), a simulator control device 20 (1) to (4), and a simulator 30 that performs simulation based on input data acquired from the simulator control device 20.

(6) The simulation system 100 according to the sixth aspect includes a first real medium (map 4a), a first camera 3a that photographs the first real medium, and a first real medium that is attached to the first real medium. 1 of the landmarks (such as piece 5a1), a second real medium (map 4b), a second camera 3b for photographing the second real medium, and a second mark attached to the second real medium. The input data generation unit includes a landmark (such as a piece 5b1), a simulator control device 20 of (1) to (4), and a simulator 30 that performs a simulation based on input data acquired from the simulator control device 20. 25 generates the first input data based on the position and attribute of the landmark based on the first image A taken by the first camera 3a and the simulated situation; The second input data is generated based on the position and attribute of the landmark based on the second image B taken by the second camera 3b and the simulated situation.
This allows simulations to be executed across multiple locations.

(7) The simulation system 100 according to the seventh aspect is the simulation system 100 of (5) to (6), in which the landmark is a three-dimensional piece.

(8) The simulation system 100 according to the eighth aspect is the simulation system 100 according to (7), wherein the three-dimensional piece has a plurality of surfaces, and any one of the surfaces is attached facing the camera. Is possible.
This allows one piece to be assigned multiple roles and functions, and to have only one of them perform.

(9) The simulation system 100 according to the ninth aspect is the simulation system 100 of (5) to (6), in which the mark is a sticky note.

(10) The simulation system 100 according to the tenth aspect is the simulation system 100 of (5) to (6), in which the mark is an image projected on the real medium.

(11) A simulator control method according to an eleventh aspect obtains an image of a real medium on which a mark is attached, detects the position and attribute of the mark on the real medium based on the image, and Input data to be input to the simulator is generated based on the simulated situation, the position, and the attribute, and the input data is input to the simulator.

(12) The program according to the twelfth aspect causes a computer to acquire an image of a real medium on which a mark is attached, and detect the position and attribute of the mark on the real medium based on the image; A process of generating input data to be input to the simulator based on a situation simulated by the simulator, the position, and the attribute, and inputting the input data to the simulator is executed.

100...Simulation system 10, 1a, 1b...Base 20...Simulator control device 21...Image acquisition section 22...Image analysis section 23...Storage section 24...Data transmission/reception section 25 ...Input data generation unit 26...Result output unit 27...Analysis unit 3a, 3b...Camera 4a, 4b...Map 5a1 to 5a5, 5b1 to 5b3...Pieces 6a, 6b...・Computer 7a, 7b...Display part 8a, 8b...Projector 900...Computer 901...CPU
902... Main storage device 903... Auxiliary storage device 904... Input/output interface 905... Communication interface

Claims (11)

a first real medium;
a first camera that photographs the first real medium;
a first mark attached to the first real medium;
a second real medium;
a second camera that photographs the second real medium;
a second mark attached to the second real medium;
A first image taken by the first camera of the first real medium to which the first mark is attached, and a first image of the second real medium to which the second mark is attached are captured by the second camera. an image acquisition unit that acquires a second image taken by the camera;
Detecting the position and attribute of the first mark in the first real medium based on the first image, and detecting the position and attribute of the second mark in the second real medium based on the second image. and an image analysis unit that detects attributes;
generating first input data based on the position and attributes of the landmark based on a first image taken by the first camera and a situation simulated by a simulator; an input data generation unit that generates second input data based on the position and attribute of the landmark based on the second image and the simulated situation;
a simulator control device comprising;
The first input data and the second input data are acquired from the simulator control device, and based on the acquired first input data and second input data, the situation of the disaster and the response to the disaster are determined. the simulator that performs a simulation that simulates the disaster situation or the situation during plant operation training that changes depending on the situation;
a first display device that displays the second image and/or simulation results by the simulator;
a second display device that displays the first image and/or simulation results by the simulator;
Equipped with
The first real medium, the first camera, the first mark, and the first display device are provided at a first base, and the second real medium and the second a camera, the second mark, and the first display device are provided at a second base,
simulation system. The input data generation unit generates the input data based on any of the color, shape, and material of the mark.
The simulation system according to claim 1. The input data generation unit selectively determines one input data regarding the landmarks attached to the same position based on the attributes of the landmarks.
The simulation system according to claim 1 or claim 2. The real medium displays any one of a map, a piping diagram, a system diagram, a network diagram, a circuit diagram, a wiring diagram, a structure diagram, an organization chart, a process diagram, a hazard map, and a table.
The simulation system according to any one of claims 1 to 3. The landmark is a three-dimensional piece,
The simulation system according to any one of claims 1 to 4 . The three-dimensional piece has a plurality of surfaces, and any one of the surfaces can be attached facing the camera.
The simulation system according to claim 5 . The mark is a sticky note,
The simulation system according to any one of claims 1 to 6 . the mark is an image projected on the real medium;
The simulation system according to any one of claims 1 to 7 . a first real medium;
a first camera that photographs the first real medium;
a first projection device that projects an image of a first mark onto the first real medium;
a second real medium;
a second camera that photographs the second real medium;
a second projection device that projects an image of a second mark onto the second real medium;
A first image taken by the first camera of the first real medium on which the first mark is projected, and a second image of the second real medium on which the second mark is projected. an image acquisition unit that acquires a second image taken by the camera;
Detecting the position and attribute of the first mark in the first real medium based on the first image, and detecting the position and attribute of the second mark in the second real medium based on the second image. and an image analysis unit that detects attributes;
generating first input data based on the position and attributes of the landmark based on a first image taken by the first camera and a situation simulated by a simulator; an input data generation unit that generates second input data based on the position and attribute of the landmark based on the second image and the simulated situation;
a simulator control device comprising;
The first input data and the second input data are acquired from the simulator control device, and based on the acquired first input data and second input data, the situation of the disaster and the response to the disaster are determined. the simulator that performs a simulation that simulates the disaster situation or the situation during plant operation training that changes depending on the situation;
a first display device that displays the second image and/or simulation results by the simulator;
a second display device that displays the first image and/or simulation results by the simulator;
Equipped with
The first real medium, the first camera, the first projection device, and the first display device are provided at a first base, and the second real medium and the first display device are provided at a first base. 2 cameras, the second projection device, and the first display device are provided at a second base,
simulation system. A first real medium, a first camera, a first mark, and a first display device are provided at a first base, and a second real medium, a second camera, and a second A landmark and a second display device are provided at the second base,
the first real medium bearing the first mark is photographed by the first camera; the second real medium bearing the second mark is photographed by the second camera;
obtaining a first image taken by the first camera and a second image taken by the second camera;
Detecting the position and attribute of the first mark in the first real medium based on the first image, and detecting the position and attribute of the second mark in the second real medium based on the second image. and discover attributes,
generating first input data based on the position and attributes of the landmark based on the first image and a situation simulated by a simulator, and generating the position and attributes of the landmark based on the second image; generating second input data based on the simulated situation;
The first input data and the second input data are acquired, and based on the acquired first input data and the second input data, the disaster changes depending on the situation of the disaster and the response to the disaster. We carry out simulations using a simulator that simulates the situation during plant operation training or the situation during plant operation training.
outputting the second image and/or the simulation result by the simulator to the first display device, and outputting the first image and/or the simulation result by the simulator to the second display device;
Simulator control method. A first real medium, a first camera, a first projection device, and a first display device are provided at a first base, and a second real medium, a second camera, and a second real medium are provided at a first base. a projection device and a second display device are provided at the second base,
projecting an image of a first landmark from the first projection device onto a first real medium; projecting an image of a second landmark from the second projection device onto the second real medium;
The first real medium to which the first mark is attached is photographed by the first camera, and the second real medium to which the second mark is attached is photographed by the second camera;
obtaining a first image taken by the first camera and a second image taken by the second camera;
Detecting the position and attribute of the first mark in the first real medium based on the first image, and detecting the position and attribute of the second mark in the second real medium based on the second image. and discover attributes,
generating first input data based on the position and attributes of the landmark based on the first image and a situation simulated by a simulator, and generating the position and attributes of the landmark based on the second image; generating second input data based on the simulated situation;
The first input data and the second input data are acquired, and based on the acquired first input data and the second input data, the disaster changes depending on the situation of the disaster and the response to the disaster. perform a simulation using the simulator that simulates the situation or the situation during plant operation training,
outputting the second image and/or the simulation result by the simulator to the first display device, and outputting the first image and/or the simulation result by the simulator to the second display device;
Simulator control method.

Images