JPWO2020045254A1 - Display system, server, display method and equipment - Google Patents

Abstract

The display system includes a detection unit, a display unit, and an operation unit. The detection unit detects the position information of the person to be educated. The display unit displays an image viewed from the viewpoint of the educated person corresponding to the position information in the virtual space. The operation unit selects the educational object included in the image. When the educational object is selected by operating the operation unit, the display unit displays the educational content of the equipment associated with the educational object.

Description

The present disclosure relates to display systems, servers, display methods and devices (particularly educational devices).

In order to improve the safety awareness of workers at work sites, a system is known in which workers can experience a simulated situation at the time of a disaster (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2001-356680

The display system of the present disclosure is a system for providing education on factory equipment. The display system includes a detection unit, a display unit, and an operation unit.

The detection unit detects the position information of the person to be educated.

The display unit displays an image viewed from the viewpoint of the educated person corresponding to the position information in the virtual space of the factory in which the educational object in the shape of the equipment is arranged and associated with the equipment.

The operation unit selects the educational object included in the image.

When the educational object is selected by operating the operation unit, the display unit displays the educational content of the equipment associated with the educational object.

The server of the present disclosure is a server for outputting educational contents for conducting education on factory equipment.

The server has an acquisition unit, an image output unit, and a content output unit.

The acquisition unit acquires the position information of the person to be educated from the detection unit.

The image output unit outputs an image viewed from the viewpoint of the education target person corresponding to the position information to the display unit in the virtual space of the factory in which the education target object in the shape of the equipment is arranged and associated with the equipment.

When the educational object included in the image is selected, the content output unit outputs the educational content of the equipment associated with the educational object to the display unit.

The display method of the present disclosure is a display method for displaying contents for providing education on factory equipment.

The display method is
Receives the location information of the educated person detected by the detector,
In the virtual space of the factory where the educational object in the shape of the equipment is placed, which is associated with the equipment, the information for displaying the image from the viewpoint of the educational subject corresponding to the location information is output to the display device. ,
When the educational object included in the image displayed on the display device is selected, the information for displaying the educational content of the equipment associated with the educational object is output to the display device.

The device of the present disclosure is a device for providing education on factory equipment.

The device includes a processor and a memory.

A program that can be executed by the processor is stored in the memory.

The processor uses the program stored in the memory
Receives the location information of the educated person from the detector and
In the virtual space of the factory where the educational object in the shape of the equipment is placed, which is associated with the equipment, an image from the viewpoint of the educational subject corresponding to the location information is generated.
Output the image to the display device
When the educational object included in the image is selected by operating the operation unit, the educational content of the equipment associated with the educational object is output to the display device.

FIG. 1 is a schematic diagram showing an outline of a display system according to an embodiment. FIG. 2 is a block diagram showing a configuration example of the display system according to the embodiment. FIG. 3 is a sequence diagram showing the operation of the display system according to the embodiment. FIG. 4 is a flowchart showing the operation of the server according to the embodiment. FIG. 5 is a schematic diagram showing a state of the virtual space according to the embodiment. FIG. 6 is a diagram showing an example of a display screen according to the embodiment. FIG. 7 is a diagram showing an example of a display screen according to the embodiment. FIG. 8 is a diagram showing an example of a display screen according to the embodiment. FIG. 9 is a diagram showing an example of a display screen according to the embodiment. FIG. 10 is a diagram showing an example of a display screen according to the embodiment. FIG. 11 is a flowchart of a modified example of the operation of the server according to the embodiment. FIG. 12 is a diagram showing an example of a display screen according to the embodiment. FIG. 13 is a flowchart of educational content output processing according to the embodiment. FIG. 14 is a diagram showing an example of a display screen at the time of risk assumption training according to the embodiment. FIG. 15 is a diagram showing an example of a display screen during an accident scenario experience according to the embodiment. FIG. 16 is a diagram showing an example of a display screen during an accident scenario experience according to the embodiment. FIG. 17 is a diagram showing an example of a display screen during an accident scenario experience according to the embodiment. FIG. 18 is a diagram showing an example of a display screen at the time of asking a question according to the embodiment. FIG. 19 is a diagram showing an example of a display screen at the time of presenting an ideal action according to the embodiment. FIG. 20 is a diagram showing an example of a display screen at the time of presenting an ideal action according to the embodiment.

The display system according to one aspect of the present disclosure is a system for providing education on equipment of a factory (facility). The display system includes a detection unit, a display unit, and an operation unit.

The detection unit detects the position information of the person to be educated.

The display unit is associated with the equipment to be educated, and in the virtual space of the factory where the educational object in the shape of the equipment is arranged, from the viewpoint of the educated person corresponding to the position information. The viewed image is displayed to the educated person.

The operation unit is used by the educated person to select an educated object included in the image.

When the education target person selects the education target object by using the operation unit, the display unit displays the education content of the equipment associated with the education target object to the education target person.

According to this, the educated person performs an active action of selecting an educated object in the virtual space. This may improve the effectiveness of education for educated people. In addition, the person to be educated performs an operation of searching for an object to be educated in the virtual space. As a result, effective education can be performed as compared with the case where the educated person simply watches the educational content. In addition, the person to be educated selects equipment having the shape of the object to be educated. As a result, it is possible to reduce mistakes in selecting educational content, as compared with, for example, selecting an icon in which only the name of the equipment to be educational is described.

For example, when the image includes an educational object, the display unit may display an icon on the educational object or around the educational object. Then, when the education target person selects the icon by the operation unit, the display unit may display the education content to the education target person.

This makes it easier for the educated person to find the educated object. Therefore, the educational target cannot find the educational target object, and it is possible to suppress an increase in the amount of information processing due to excessive passage of time and a decrease in the motivation of the educational target.

For example, the display unit may display a pointer pointing to a position on the image based on the operation of the educated person. Then, when the education target person performs a selection operation by the operation unit while the icon is pointed by the pointer, the display unit may display the education content on the education target person. Good.

According to this, the educated person can intuitively select the educated object. Therefore, it is possible to reduce selection mistakes.

For example, the display unit may display a pointer pointing to a position on the image based on the operation of the educated person. Then, when the education target person performs a selection operation by the operation unit while the education target object is pointed by the pointer, the display unit displays the education content to the education target person. You may.

According to this, the educated person can intuitively select the educated object. Therefore, it is possible to reduce selection mistakes.

For example, the display unit may display a pointer pointing to a position on the image based on the operation of the educated person. Then, when the education target object is pointed by the pointer, the display unit may display an icon on the education target object or around the education target object. Then, when the education target person performs a selection operation by the operation unit while the icon is displayed, the display unit may display the education content to the education target person.

This makes it easier for the educated person to find the educated object. Therefore, it is possible to prevent the education target person from finding the education target object, increasing the amount of information processing due to excessive passage of time, and reducing the motivation of the education target person. In addition, it is more difficult to find the object to be educated than when the icon is always displayed, so that the person to be educated needs to think. As a result, the effect of education can be improved.

For example, the educational content may include a virtual experience in the virtual space.

According to this, the educational effect can be improved by the experience with a sense of presence. In addition, it is not necessary to separately prepare a device for virtual experience in the virtual space, which simplifies the configuration of the device.

For example, the virtual experience may include a dangerous experience with respect to the educated object.

According to this, safety training can be effectively performed. In addition, it is not necessary to separately prepare a device for actually experiencing a danger, which simplifies the configuration of the device.

For example, the educational content may include a question to the educated person regarding the dangerous experience.

According to this, it is possible to promote the thinking of the person to be educated, so that the educational effect can be improved. In addition, there is no need to separately prepare a device for asking questions about dangerous experiences, which simplifies the configuration of the device.

For example, the educational content may include content that is related to the dangerous experience and indicates an action to be taken by the educated person.

According to this, the educational effect can be improved. In addition, it is not necessary to separately prepare a device for displaying the content indicating the action to be performed by the educated person, and the device configuration is simplified.

For example, the educational content may include content that is related to the educational object and causes the educational subject to select a dangerous place.

According to this, it is possible to promote the thinking of the person to be educated, so that the educational effect can be improved. In addition, it is not necessary to separately prepare a device for displaying the content that allows the educated person to select a dangerous place, which simplifies the configuration of the device.

For example, the virtual space may be generated using an image of the target facility.

According to this, since it is possible to generate a virtual space close to the state of the actual target facility, it is possible to improve the sense of presence. In addition, it is not necessary to separately prepare an image of the target facility, which simplifies the configuration of the device.

For example, the display system may further include a vibrating unit that vibrates the educational subject depending on the content of the educational content.

According to this, the educational effect can be improved by the experience with a sense of presence. In addition, it is not necessary to separately prepare a device that vibrates the trainee, and the device configuration is simplified.

The server according to one aspect of the present disclosure is a server for outputting educational contents for providing education on factory equipment. The server has an acquisition unit, an image output unit, and a content output unit.

The acquisition unit acquires the position information of the person to be educated from the detection unit.

The image output unit is associated with the equipment to be educated, and the viewpoint of the educated person corresponding to the position information in the virtual space of the factory in which the educated object in the shape of the equipment is arranged. The image seen from is output to the display unit.

When the education target person selects the education target object included in the image, the content output unit outputs the education content of the equipment associated with the education target object to the display unit.

According to this, the educated person performs an active action of selecting an educated object in the virtual space. This may improve the effectiveness of education for educated people. In addition, by performing the operation of searching for the object to be educated in the virtual space by the educated person, more effective education can be performed as compared with the case where the educated person simply views the educational content. In addition, the person to be educated selects equipment having the shape of the object to be educated. As a result, it is possible to reduce mistakes in selecting educational content as compared with, for example, selecting an icon on which the name of the equipment to be educational is described.

The display method according to one aspect of the present disclosure is a display method for displaying contents for providing education on factory equipment.

The display method of the present disclosure receives the position information of the education target person detected by the detection unit, associates it with the equipment to be educated, and arranges the education target object in the shape of the equipment. In the virtual space of the factory, information for displaying the image seen from the viewpoint of the education target person corresponding to the position information to the education target person is output to the display device, and the education target person causes the education target person to display the display device. When the educational target object included in the displayed image is selected, the information for displaying the educational content of the equipment associated with the educational target object to the educational target person is output to the display device.

According to this, the educated person performs an active action of selecting an educated object in the virtual space. This may improve the effectiveness of education for educated people. In addition, by performing the operation of searching for the object to be educated in the virtual space by the educated person, more effective education can be performed as compared with the case where the educated person simply views the educational content. In addition, the person to be educated selects equipment having the shape of the object to be educated. As a result, it is possible to reduce mistakes in selecting educational content as compared with, for example, selecting an icon on which the name of the equipment to be educational is described.

The device according to one aspect of the present disclosure is a device for providing education on factory equipment. The device includes a processor and a memory.

A program that can be executed by the processor is stored in the memory.

The processor receives the position information of the person to be educated from the detection unit by using the program stored in the memory, associates it with the equipment to be educated, and determines the shape of the associated equipment. In the virtual space of the factory where the educational target object is arranged, an image seen from the viewpoint of the educational target person corresponding to the position information is generated, and the image is displayed for displaying to the educational target person. When the output is output to the device and the education target person selects the education target object included in the image by the operation unit, the education content of the equipment associated with the education target object is sent to the education target person. Output to the display device for display.

According to this, the educated person performs an active action of selecting an educated object in the virtual space. This may improve the effectiveness of education for educated people. In addition, by performing the operation of searching for the object to be educated in the virtual space by the educated person, more effective education can be performed as compared with the case where the educated person simply views the educational content. In addition, the person to be educated selects equipment having the shape of the object to be educated. As a result, it is possible to reduce mistakes in selecting educational content as compared with, for example, selecting an icon on which the name of the equipment to be educational is described.

It should be noted that these comprehensive or specific embodiments may be realized in a recording medium such as a system, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM. Further, it may be realized by any combination of a system, a method, an integrated circuit, a computer program and a recording medium.

Hereinafter, embodiments will be specifically described with reference to the drawings.

It should be noted that all of the embodiments described below show a specific example of the present disclosure. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present disclosure. Further, among the components in the following embodiments, the components not described in the independent claims indicating the highest level concept are described as arbitrary components.

FIG. 1 is a schematic diagram showing an outline of the display system 100 according to the present embodiment. In the following, an example will be described in which the display system 100 is a system for providing safety education to workers who perform manufacturing work or the like in a facility such as a factory. The application of the display system 100 is not limited to this. For example, the display system 100 can be used for safety education not only in factories but also in arbitrary facilities such as schools, hospitals, and research facilities. Further, the display system 100 can be used not only for safety education but also for other educational purposes such as education on how to use the device.

The display system 100 includes a headset 103 and two controllers 104. Further, the display system 100 may have a server 102 and two position sensors 105. The display system 100 is, for example, a system for providing education on equipment of a factory (facility). In this embodiment, two controllers 104 and two position sensors 105 are used. However, the number of controllers 104 is not limited to two, and may be one or three or more. Further, the number of position sensors 105 may be one or three or more.

The headset 103 is worn on the head of an educated person 101 who receives safety education. The two controllers 104 are held by both hands of the educated person 101. The two position sensors 105 are used to detect the positions of the headset 103 and the controller 104.

FIG. 2 is a block diagram of the display system 100. As shown in FIG. 2, the server 102 is connected to the headset 103 via the network 106. The server 102 generates images and sounds to be reproduced by the headset 103 based on the position of the headset 103 and the operation contents of the controller 104 by the educated person 101 (see FIG. 1), and heads the generated images and sounds. Output to set 103. The server 102 includes a storage unit 121, an acquisition unit 122, an image output unit 123, a content output unit 124, and an NW (network) communication unit 125.

The storage unit 121 stores three-dimensional information indicating a virtual space of a target facility such as a factory. A plurality of educational objects are arranged in the virtual space. In addition, the storage unit 121 stores a plurality of educational contents associated with the plurality of educational object objects. For example, each of a plurality of educational object objects is associated with a plurality of educational target facilities. Each educated object has the shape of the associated equipment. Further, the educational content of the educational object is the educational content of the equipment associated with the educational content.

Educational content includes images (moving images or still images), audio, control information, and the like. The control information includes, for example, information for controlling the vibration of the controller 104 and the like.

Further, the above three-dimensional information is, for example, a point cloud generated by using images of the target facility taken from a plurality of viewpoints. The three-dimensional information is not limited to the one generated from the captured image, and may be computer graphics. Further, the three-dimensional information may be a combination of computer graphics and the one generated from the captured image. Further, as a method of constructing the virtual space, a 360-degree image obtained by photographing the target facility may be used, or a combination of the 360-degree image and three-dimensional information (point cloud or the like) may be used.

The acquisition unit 122 acquires the position information of the headset 103, the position information of the controller 104, and the operation contents from the headset 103.

Based on the position of the headset 103, the image output unit 123 generates an image viewed from the viewpoint of the educational subject 101 corresponding to the position of the headset 103 in the virtual space. The position in the present application includes, for example, three-dimensional coordinates and a posture (tilt). The position may be either three-dimensional coordinates or inclination, or two-dimensional coordinates (for example, horizontal coordinates) may be used instead of the three-dimensional coordinates.

Further, when the generated image includes the education target object, the image output unit 123 superimposes the icon of the education target object on the image and outputs the obtained image.

When the education target person 101 selects the education target object included in the screen, the content output unit 124 outputs the education content associated with the education target object to the headset 103.

The NW communication unit 125 receives the position information of the headset 103, the position information of the controller 104, and the operation contents from the headset 103 via the network 106. Further, the NW communication unit 125 transmits the image generated by the image output unit 123 and the educational content to the headset 103 via the network 106.

The headset 103 reproduces images, sounds, and the like transmitted from the server 102. The headset 103 includes a NW communication unit 131, a communication unit 132, a speaker 133, and a display unit 134. The NW communication unit 131 receives the image, voice, control information, and the like transmitted from the server 102. Further, the NW communication unit 131 transmits the position information of the headset 103, the position information of the controller 104, and the operation contents to the server 102 via the network 106. The communication method between the server 102 and the headset 103 is not particularly limited, and any method such as wired or wireless may be used.

The communication unit 132 communicates with the controller 104. Specifically, the communication unit 132 transmits the control information transmitted from the server 102 to the controller 104. Further, the communication unit 132 receives the position information and the operation content of the controller 104 transmitted from the controller 104, and outputs the received information to the NW communication unit 131.

The speaker 133 outputs the sound transmitted from the server 102. The display unit 134 displays the image transmitted from the server 102.

The headset 103 has a detection unit 135. The detection unit 135 detects the position of the headset 103 (education target person 101). Specifically, the detection unit 151 included in the position sensor 105 scans and irradiates the infrared light laser. The detection unit 135 has a plurality of light receiving units. Each light receiving unit receives infrared light lasers emitted from the two position sensors 105. The detection unit 135 detects the position of the headset 103 based on the irradiation direction in the laser detection unit 151 received by each light receiving unit and the time from the laser irradiation to the reception. The detected position information of the headset 103 is output to the NW communication unit 131.

Here, as the position detection method, a method using an infrared laser is illustrated, but the position detection method is not limited to this, and any known method may be used. For example, the headset 103 is provided with a plurality of light emitting units that emit infrared or visible light, and the position of the headset 103 is determined based on an image obtained by an infrared or visible light camera provided on the position sensor 105. It may be detected.

Further, in addition to the information obtained by the above position detection method, the position information of the headset 103 may be calculated based on the information obtained by the gyro sensor (not shown) or the like included in the headset 103. Position information may be calculated based only on the information obtained by a gyro sensor (not shown) or the like.

The controller 104 includes an operation unit 141, a communication unit 142, a vibration unit 143, and a detection unit 144. The operation unit 141 is an input interface for the education target person 101 to select the education target object included in the image, and accepts the operation of the education target person. For example, the operation unit 141 is one or more operation buttons. The method of accepting the operation of the person to be educated is not limited to this, and the operation may be accepted based on the operation of shaking the controller 104, the posture of the controller 104, or the like. Further, an input method using voice input or another input device may be used, or a plurality of input methods may be used in combination.

The communication unit 142 communicates with the headset 103. Specifically, the communication unit 142 transmits the operation content for the operation unit 141 and the position information of the controller 104 to the headset 103. In addition, the communication unit 142 receives the control information transmitted from the headset 103. The vibrating unit 143 is controlled based on this control information. The vibrating unit 143 vibrates the educational target person 101 according to the content of the educational content.

Here, the vibrating unit 143 provided in the controller 104 is configured to give vibration to the educational subject 101, but the vibrating unit provided in the headset 103 may give vibration to the educational subject 101. Further, the headset 103, the controller 104 or another device attached thereto may be provided with a device for giving the educated person 101, for example, heat, wind, water, electrical stimulation, or tactile stimulation.

Further, the communication method between the headset 103 and the controller 104 is not particularly limited, and any method such as wired or wireless may be used.

The detection unit 144 detects the position of the controller 104. The position detection method is the same as the method for detecting the position of the headset 103.

Next, the operation of the display system 100 will be described. FIG. 3 is a sequence diagram showing an operation flow in the display system 100. First, the headset 103 detects the position of the education target person 101 (the position of the headset 103) (S101), and transmits the detected position information of the education target person to the server 102 (S102).

The server 102 generates an image corresponding to the position of the person to be educated, and transmits the generated image to the headset 103 (S103). The processes of steps S101 to S103 are repeated every time the position of the educational subject 101 changes.

When the controller 104 is operated by the educated person 101, the controller 104 detects the position of the controller 104 (S104) and transmits the position information of the controller 104 and the operation information for the operation unit 141 and the like to the server 102. (S105).

When the educational target object of the educational target content is selected by the above operation (S106), the server 102 transmits the educational content corresponding to the selected educational target object to the headset 103 (S107).

Further, when the controller 104 is operated by the trainee 101, the controller 104 detects the position of the controller 104 (S108) and transmits the position information of the controller 104 and the operation information for the operation unit 141 and the like to the server 102. (S109).

When the operation for the educational target content is performed by the above operation (S110), the server 102 transmits the result corresponding to the operation to the headset 103 and the controller 104 (S111 and S112). Specifically, the screen displayed on the headset 103 is updated, the vibration of the controller 104 is controlled, and the like.

FIG. 4 is a flowchart of processing by the server 102. First, the server 102 acquires the position information (position information of the headset 103) of the educated person 101 (S201). Next, the server 102 generates an image viewed from the viewpoint of the educated person 101 corresponding to the acquired position information in the virtual space based on the three-dimensional information stored in the storage unit 121, and generates the generated image. Output to the headset 103 (S202).

If the image does not include the object to be educated (No in S203), step S201 and subsequent steps are performed again at a predetermined cycle.

When the image includes an educational object (Yes in S203), the server 102 outputs an icon of the educational object (S204). Specifically, the server 102 superimposes an icon on the image and outputs the generated image to the headset 103.

In this state, when the icon is selected by the operation of the education target person 101 (Yes in S205), the server 102 outputs the educational content associated with the selected icon to the headset 103 (S206). .. On the other hand, when the icon is not selected by the operation of the educated person 101 (No in S205), step S201 and subsequent steps are performed again at a predetermined cycle.

FIG. 5 is a schematic diagram showing an example of the virtual space 161 of the target facility. In the example shown in FIG. 5, four objects 162A to 162D such as equipment are arranged in the virtual space. Objects 162A, 162B, and 162D are educational object objects 162 to which educational contents are associated. Object 162C is a normal object that is not an educational object. 6 to 8 are diagrams showing examples of display screens of the fields of view (1) to (3) shown in FIG. 5, respectively. As shown in FIGS. 6 and 8, when the education target object 162 (objects 162A, 162B, 162D) is included in the screen, the icon 164 is displayed in association with the education target object. For example, the icon 164 is displayed around the educational object or superimposed on the educational object. For example, the icon 164 is for highlighting the educational object. Further, the icon 164 may include an educational object, character information, a figure, or the like explaining the educational content associated with the educational object.

Further, as shown in FIG. 8, the icon 164 is not displayed on the normal object 162C. Further, as shown in FIG. 7, when the image does not include the object to be educated, the icon 164 is not displayed.

9 and 10 are diagrams showing a detailed example of the display screen. As shown in FIG. 9, a pointer 165, which is a laser pointer, is displayed on the screen. The pointer 165 points to an arbitrary position on the screen according to the orientation of the controller 104.

In the example of FIG. 9, the educational object is not included in the screen. In this case, the education target person 101 searches for the education target object by changing the line-of-sight direction or moving the position. In the example of FIG. 10, the education target object 162 is included in the screen, and the icon 164 is displayed on the education target object 162. In this state, the educator 101 selects the icon 164 by pointing to the icon 164 with the pointer 165 and performing a selection operation (for example, pressing an operation button) by the operation unit 141.

As described above, when the education target person 101 performs the selection operation by the operation unit 141 in the state where the education target object 162 is pointed by the pointer 165, the education content is displayed on the screen of the display unit 134. By displaying the icon 164, the education target person 101 can easily find the education target object 162. Therefore, it is possible to prevent the educational target person 101 from finding the educational target object 162, excessively elapse of time, and reducing the motivation of the educational target person 101.

Although the example in which the icon 164 is always displayed is shown here, the icon 164 may be displayed only when the educational object 162 is pointed by the pointer 165. FIG. 11 is a flowchart of the operation of the server 102 in this case. In the process shown in FIG. 11, step S207 is added to the process shown in FIG. Specifically, when the image includes the education target object 162 (Yes in S203) and the education target object 162 is pointed to by the pointer 165 (Yes in S207), the server 102 outputs the icon 164 (Yes). S204). Further, when the object to be educated is not pointed by the pointer 165 (No in S207), the server 102 does not output the icon 164.

FIG. 12 is a diagram showing a screen example at this time. As shown in FIG. 12A, even when the education target object 162 is included in the screen, the icon 164 is not displayed if the pointer 165 does not point to the education target object 162. As shown in FIG. 12B, the icon 164 is displayed when the pointer 165 points to the educational object 162.

In this way, when the educational object 162 is pointed to by the pointer 165, the icon 164 is displayed. When the educational subject 101 performs a selection operation (for example, pressing an operation button) by the operation unit 141 while the icon 164 is displayed, the educational content is displayed on the screen of the display unit 134.

This makes it more difficult to find the object to be educated than when the icon is always displayed, so that the person to be educated needs to think. As a result, the effect of education can be improved. Further, since the icon 164 is displayed when the pointer 165 points to the object, the education target object 101 can easily find the education target object 162 as compared with the case where the icon 164 is not displayed at all.

The icon 164 may not be displayed even when the pointer 165 points to the educational object 162. This makes it harder to find the object to be educated. That is, when the education target person 101 performs a selection operation (for example, pressing an operation button) by the operation unit 141 while the education target object 162 is pointed by the pointer 165, the education content is displayed on the screen of the display unit 134. It may be displayed.

Further, the icon 164 may be displayed on both the educational object 162 and the normal object. Even in this case, when the educational object 162 is selected, the educational content is played, and when the normal object is selected, the educational content is not played. As a result, selectable candidates can be presented to the education target person 101, so that the education target object can be easily found. On the other hand, it is possible to make it difficult to select the education target object 162 as compared with the case where the icon 164 is displayed only on the education target object 162.

It should be noted that the above-mentioned plurality of methods may be set. Further, the method to be used may be switched according to a predetermined condition. For example, when the education target object 162 is not selected for a predetermined time, that is, when the education target object 101 cannot find the education target object 162, the method to be used may be switched to a method that is easier to select.

As described above, the education target person 101 performs an active operation of selecting the education target object 162 in the virtual space. This may improve the effect of education on the educated person 101. Further, by performing the operation of searching for the object to be educated in the virtual space by the educated person 101, more effective education can be performed as compared with the case where the educated person 101 simply views the educational content. ..

As a method for realizing the virtual space, both the coordinates and the posture of the educated person 101 (headset 103) may be used, or the coordinates may be fixed and the screen may be changed based on the posture. Further, the movement of the coordinates may be performed not by the movement of the education target person 101 but by the operation of the education target person 101 via the controller 104 or the like. Further, only two-dimensional or one-dimensional movement may be reflected, such as only in the horizontal direction or only in the vertical direction. Similarly, only changes in attitude in a particular direction may be reflected.

Further, a stereoscopic display in which different images having parallax are displayed in the left and right eyes may be used, or a method in which the same image is displayed in the left and right eyes may be used.

The method for realizing these virtual spaces is the same for the virtual experience included in the educational content described later.

Next, the details of the educational content will be described. Educational content includes, for example, virtual experiences in virtual space. The virtual experience also includes, for example, a dangerous experience with respect to the educational object 162.

FIG. 13 is a flowchart of the educational content reproduction process (S206 of FIG. 4). First, the headset 103 displays a screen for risk assumption training (S221). The danger assumption training is, for example, content related to the educational object 162 and causing the educational subject 101 to select a place at risk.

FIG. 14 is a diagram showing an example of a display screen during the risk assumption training. As shown in FIG. 14, the danger assumption training screen 166 is displayed. The danger assumption training screen 166 shows a photograph of the object to be educated, and a plurality of places are marked as danger candidates 167. The educated person 101 selects the danger candidate 167 with the pointer 165 and gives the selection mark 168 by pressing the operation unit 141 (operation button). The educated person 101 selects the determination button 169 after giving the selection mark 168. As a result, the result of the correct answer or the incorrect answer according to the selection result is displayed (S222).

Although a plurality of danger candidates 167 are displayed here, a method of marking an arbitrary position may be used. Further, the selection location does not have to be multiple. Further, the content is not limited to the content of selecting the danger portion, and may be any question related to the danger assumption training of the educational object 162.

Further, although an example in which a two-dimensional image is displayed is shown here, a method of selecting a dangerous place in the virtual space may be used.

Next, an accident scenario in which a dangerous experience such as an accident or a dangerous state is virtually experienced is started (S223). 15 to 17 are diagrams showing screen examples of accident scenarios. Here, as shown in FIG. 15, an example of virtually experiencing the work of a maintenance worker will be described. As shown in FIG. 16, the controller 104 operates the hand 171 in the virtual space. For example, by operating the operation unit 141 (operation button), the operation of holding the hand 171 is performed. Also, this example is an experience when the device breaks down. As shown in FIG. 17, for example, when the tube 172a (see FIG. 16) is pulled out, the drive unit 172 pops out due to the residual pressure, and the accident in which the drive unit 172 collides with the worker is reproduced. For example, the controller 104 is controlled to vibrate in the event of a collision. Further, in the accident scenario, sounds such as environmental sounds and sound effects are reproduced in accordance with the video. The vibrating unit 143 is not built in the controller 104, and may be separately attached to the trainee 101.

Next, a question to the educated person 101 related to the accident scenario is displayed (S224). FIG. 18 is a diagram showing an example of the question screen 173. As shown in FIG. 18, for example, the content of asking the educated person 101 about the cause of the accident, the improvement point, and the like is displayed. Although an example in which an image is displayed is shown here, a question may be asked by voice or the like. Further, in the virtual space, a character or the like may ask the educated person 101 a question.

Next, in relation to the accident scenario, the action to be taken to prevent the accident or the action to be taken to indicate the correct action to be taken in the event of an accident is presented (S225). 19 and 20 are diagrams showing an example of a screen at the time of presenting an ideal action. For example, as shown in FIGS. 19 and 20, an image 174 explaining the cause of the accident and an image 175 showing the action to be taken when the accident has occurred are displayed. In addition, these presentations may be performed using either a still image or a moving image. It may also be done in virtual space. In addition, audio explanation may be used.

As described above, according to the display system 100 according to the present embodiment, the educational effect can be improved by the realistic experience using the virtual space, and the safety training can be effectively performed. In addition, the educational effect can be improved by performing an active action by the educational subject 101.

Although the display system according to the embodiment has been described above, the present disclosure is not limited to this embodiment. For example, the display system 100 of the present disclosure can be used for safety education not only in factories but also in facilities such as schools, hospitals, and research facilities.

That is, the display system of the present disclosure is a system for providing education on the equipment of the facility. The display system includes a detection unit, a display unit, and an operation unit.

The detection unit detects the position information of the person to be educated.

The display unit displays an image viewed from the viewpoint of the educated person corresponding to the position information in the virtual space of the facility in which the educational object in the shape of the equipment is arranged and associated with the equipment.

The operation unit selects the educational object included in the image.

When the educational object is selected by operating the operation unit, the display unit displays the educational content of the equipment associated with the educational object.

The server of the present disclosure is a server for outputting educational contents for conducting education on the equipment of the facility.

The server has an acquisition unit, an image output unit, and a content output unit.

The acquisition unit acquires the position information of the person to be educated from the detection unit.

The image output unit outputs an image viewed from the viewpoint of the education target person corresponding to the position information to the display unit in the virtual space of the facility in which the education target object in the shape of the equipment is arranged and associated with the equipment.

When the educational object included in the image is selected, the content output unit outputs the educational content of the equipment associated with the educational object to the display unit.

The display method of the present disclosure is a display method for displaying contents for providing education on facilities of facilities.

The display method is
Receives the location information of the educated person detected by the detector,
In the virtual space of the facility where the educational object in the shape of the equipment is placed, which is associated with the equipment, the information for displaying the image from the viewpoint of the educational subject corresponding to the location information is output to the display device. ,
When the educational object included in the image displayed on the display device is selected, the information for displaying the educational content of the equipment associated with the educational object is output to the display device.

The device of the present disclosure is a device for providing education on the equipment of the facility.

The device includes a processor and a memory.

A program that can be executed by the processor is stored in the memory.

The processor uses the program stored in the memory
Receives the location information of the educated person from the detector and
In the virtual space of the facility where the educational object in the shape of the equipment is placed, which is associated with the equipment, an image from the viewpoint of the educational subject corresponding to the location information is generated.
Output the image to the display device
When the educational object included in the image is selected by operating the operation unit, the educational content of the equipment associated with the educational object is output to the display device.

For example, the configuration of the display system 100 shown in FIG. 2 is an example, and a process executed by one device may be executed by another device, or a plurality of processes executed by one device may be executed by a plurality of devices. It may be divided and processed, or a plurality of processes executed by a plurality of devices may be executed by a single device. For example, some or all of the functions of the server 102 may be included in the headset 103.

Further, a part or all of the processing units included in each device included in the display system according to the above embodiment is typically realized as an LSI (Large Scale Integration) which is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include a part or all of them.

Further, the integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connection and settings of circuit cells inside the LSI may be used.

Further, in the above-described embodiment, each component may be realized by being composed of dedicated hardware or by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

Further, the present disclosure may be realized as each device included in the display system. Further, the present disclosure may be realized as an educational content display method, an educational method, or the like executed by one or more devices included in the display system.

Further, the division of the functional block in the block diagram is an example, and a plurality of functional blocks can be realized as one functional block, one functional block can be divided into a plurality of functional blocks, and some functions can be transferred to other functional blocks. You may. Further, the functions of a plurality of functional blocks having similar functions may be processed by a single hardware, or may be processed by software in parallel or in a time division manner.

Further, the order in which each step in the flowchart is executed is for exemplifying for the purpose of specifically explaining the present disclosure, and may be an order other than the above. Further, a part of the above steps may be executed at the same time (parallel) as other steps.

Although the display system according to one or more aspects has been described above based on the embodiment, the present invention is not limited to this embodiment. As long as the gist of the present disclosure is not deviated, various modifications that can be conceived by those skilled in the art are applied to the present embodiment, and a form constructed by combining components in different embodiments is also within the scope of one or more embodiments. May be included within.

As described above, the present disclosure can provide a display system, server, display method or device capable of effective education.

The present disclosure can be applied to a display system, for example, a system for providing safety education in a facility such as a factory.

100 Display system 101 Educated person 102 Server 103 Headset 104 Controller 105 Position sensor 106 Network 121 Storage unit 122 Acquisition unit 123 Image output unit 124 Content output unit 125, 131 NW communication unit 132, 142 Communication unit 133 Speaker 134 Display unit 135 144, 151 Detection unit 141 Operation unit 143 Vibration unit 161 Virtual space 162, 162A, 162B, 162D Educational object 162C Normal object 164 Icon 165 Pointer 166 Danger assumption training screen 167 Danger candidate 168 Selection mark 169 Judgment button 171 Hand 172 Drive Part 172a Tube 173 Question screen 174,175 Image

Claims (15)

A display system for providing education on factory equipment.
A detector that detects the location information of the person to be educated,
A display unit that displays an image viewed from the viewpoint of the education target person corresponding to the position information in the virtual space of the factory in which the education target object in the shape of the equipment is arranged in association with the equipment.
An operation unit for selecting the educational object included in the image, and
With
When the education target object is selected by operating the operation unit, the display unit is a display system that displays educational contents of the equipment associated with the education target object. The display unit
When the image includes the educational object, an icon is displayed on the educational object or around the educational object.
The display system according to claim 1, wherein when the icon is selected by the operation unit, the educational content is displayed. The display unit
A pointer pointing to the position on the image is displayed based on the operation of the educated person.
The display system according to claim 2, wherein the educational content is displayed by operating the operation unit in a state where the icon is pointed by the pointer. The display unit
A pointer pointing to the position on the image is displayed based on the operation of the educated person.
The display system according to claim 1, wherein the educational content is displayed by operating the operation unit in a state where the educational object is pointed by the pointer. The display unit
A pointer pointing to the position on the image is displayed based on the operation of the educated person.
When the education target object is pointed by the pointer, an icon is displayed on the education target object or around the education target object.
The display system according to claim 1, wherein the educational content is displayed by operating the operation unit while the icon is displayed. The display system according to any one of claims 1 to 5, wherein the educational content includes a virtual experience in the virtual space. The display system according to claim 6, wherein the virtual experience includes a dangerous experience related to the educational object. The display system according to claim 7, wherein the educational content includes a question to the educated person regarding the dangerous experience. The display system according to claim 7 or 8, wherein the educational content includes content indicating an action to be taken by the educated person in relation to the dangerous experience. The display system according to any one of claims 1 to 9, wherein the educational content includes content related to the educational object and causing the educational subject to select a dangerous place. The display system according to any one of claims 1 to 10, wherein the virtual space is generated by using an image of the factory. A vibrating part that vibrates the educational subject according to the content of the educational content,
The display system according to any one of claims 1 to 11, further comprising. It is a server for outputting educational contents for conducting education on factory equipment.
The acquisition unit that acquires the location information of the educated person from the detection unit,
An image that outputs an image seen from the viewpoint of the education target person corresponding to the position information to the display unit in the virtual space of the factory in which the education target object in the shape of the equipment is arranged in association with the equipment. Output section and
A server including a content output unit that outputs educational content of equipment associated with the educational object to the display unit when the educational object included in the image is selected. It is a display method that displays content for education on factory equipment.
Receives the location information of the educated person detected by the detector,
Information for displaying an image viewed from the viewpoint of the education target person corresponding to the position information in the virtual space of the factory in which the education target object in the shape of the equipment is arranged in association with the equipment. Output to the display device
When the educational object included in the image displayed on the display device is selected, information for displaying the educational content of the equipment associated with the educational object is output to the display device.
Display method. It is a device for providing education on factory equipment.
With the processor
A memory in which a program that can be executed by the processor is stored, and
With
The processor uses the program stored in the memory.
Receives the location information of the educated person from the detector and
In the virtual space of the factory where the educational object in the shape of the equipment is arranged in association with the equipment, an image seen from the viewpoint of the educational subject corresponding to the position information is generated.
The image is output to the display device and
When the educational object included in the image is selected by operating the operation unit, the educational content of the equipment associated with the educational object is output to the display device.
apparatus.

Images