JP2021157696A - Review device, review system, and review method - Google Patents

Abstract

To provide a review device capable of easily verifying maintainability and the like of a plant.SOLUTION: A review device 1 is a device for reviewing an industrial plant. Intermediate data conversion means 100 converts CAD data 200 of a plant into intermediate data 210 containing a plurality of surface data. Avatar placement means 110 arranges an avatar of a reviewer in a coordinates system of a same scale as the intermediate data 210 converted by the intermediate data conversion means 100. Drawing means 120 draws a virtual space corresponding to the intermediate data 210 according to a viewpoint position of the avatar arranged by the avatar placement means 110.SELECTED DRAWING: Figure 2

Description

The present invention particularly relates to a review device, a review system, and a review method for reviewing (verifying) an industrial plant.

Conventionally, industrial plants have been designed using three-dimensional (3D) CAD (Computer-Aided Design) data.
With reference to Patent Document 1, a graph for route search including the start and end points of the pipe is created from the input unit for inputting the CAD data and the pipe start and end point data, and the CAD data and the pipe start and end point data input in the input unit. In the piping route search device having the graph creation unit, the cumulative distance from the start point and the cumulative number of parts that can be arranged are aggregated from the graph created by the graph creation unit, and the cumulative distance and the cumulative arrangement are performed. Described is a piping route search device characterized by including a display unit that displays the number of possible parts on each node of the graph.
The apparatus of Patent Document 1 is characterized in that it efficiently creates piping route data that secures installation and operation space of piping parts and reduces piping design time.

Japanese Unexamined Patent Publication No. 2012-155565

However, with the technique of Patent Document 1, it is difficult to evaluate (review) the maintainability of the actually designed plant.

The present invention has been made in view of such a situation, and an object of the present invention is to solve the above-mentioned problems.

The review device of the present invention is a review device for reviewing an industrial plant, and is an intermediate data conversion means for converting CAD data of the plant into intermediate data including a plurality of surface data, and the intermediate data conversion means. The intermediate data is placed in a virtual space corresponding to the avatar placement means for arranging the reviewer's avatar in the coordinate system of the same scale as the intermediate data converted by and the viewpoint position of the avatar placed by the avatar placement means. It is characterized in that it is provided with a drawing means for drawing as.
The review device of the present invention displays an image of the virtual space drawn by the drawing means, is connected to a head-mounted display capable of acquiring the position and orientation of the real space, and the avatar placement means is in the virtual space. The position of the head of the avatar is aligned with the position and orientation of the real space acquired by the head-mounted display.
In the review device of the present invention, the avatar arranging means aligns the position of the sole of the avatar with the position of the substantially horizontal plane that first contacts the avatar from the lumbar region in the downward direction of the body axis in the virtual space. It is a feature.
In the review device of the present invention, the avatar placement means acquires the instruction of the reviewer and sets whether or not to apply gravity to the avatar and / or whether or not the avatar is in the high-speed movement mode for moving the avatar at high speed. In the case of the setting where gravity is not applied or in the high-speed movement mode, the virtual space can be moved in the vertical direction without determining the contact with the surface in the virtual space.
The review device of the present invention is further provided with a contact determination means for determining contact between the avatar and a surface other than the substantially horizontal plane in the virtual space while the avatar is moving.
In the review device of the present invention, when the contact determination means determines contact, a marker is added to the contact position of the surface in the virtual space, and / or the reviewer is warned by voice output. It is characterized by.
The review device of the present invention is connected to a controller capable of acquiring the position and orientation in the real space, and the avatar arranging means acquires the position of the avatar's hand in the virtual space by the head-mounted display. According to the position in the real space, the contact determination means determines the contact with the surface in the virtual space even for the tool virtually held by the hand of the avatar.
The review device of the present invention is characterized in that the drawing means does not draw a surface deeper than a specific threshold value corresponding to the scale of the intermediate data in the field of view of the avatar.
The review system of the present invention is a review system including a review device for reviewing an industrial plant and a head-mounted display, and is an intermediate that converts CAD data of the plant into intermediate data including a plurality of surface data. At the data conversion means, the avatar placement means for arranging the reviewer's avatar in the coordinate system of the same scale as the intermediate data converted by the intermediate data conversion means, and the viewpoint position of the avatar placed by the avatar placement means. Correspondingly, it is characterized by including a drawing means for drawing the virtual space including the intermediate data and a head-mounted display for displaying an image of the virtual space drawn on the drawing means.
The review method of the present invention is a review method executed by a review device for reviewing an industrial plant, in which the CAD data of the plant is converted into intermediate data including a plurality of surface data, and the converted data is described. A reviewer's avatar is placed in a coordinate system of the same scale as the intermediate data, and the intermediate data is drawn as a virtual space corresponding to the viewpoint position of the avatar.

According to the present invention, the CAD data of the plant is converted into intermediate data including a plurality of surface data, the reviewer's avatar is placed in the coordinate system of the same scale as the intermediate data, and the intermediate is corresponding to this viewpoint position. By drawing a virtual space corresponding to the data, it is possible to provide a review device capable of easily reviewing the plant.

It is a system block diagram of the review system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the functional structure of the review system shown in FIG. It is a flowchart of the review process which concerns on 1st Embodiment of this invention. It is a conceptual diagram of the sole processing shown in FIG. It is a conceptual diagram of the sole processing shown in FIG. It is a conceptual diagram of the marker addition process shown in FIG. It is a screen example of the drawing process shown in FIG. It is a block diagram which shows the functional structure of the review system which concerns on 2nd Embodiment of this invention. It is a flowchart of the review process which concerns on 2nd Embodiment of this invention. It is a screen example of the review process shown in FIG.

<First Embodiment>
[System configuration of review system X]
First, the system configuration of the review system X according to the embodiment of the present invention will be described with reference to FIG. The review system X of the present embodiment is configured by connecting the HMD 2 and the controller 3 to the review device 1.

The review device 1 is an information processing device including a control calculation means and a recording medium for performing evaluation (review) at the design stage of an industrial plant. The review device 1 may be, for example, a portable or stationary PC (Personal Computer), FC (Factory Computer), workstation, server, mobile terminal such as a smartphone or tablet terminal, or the like.

HMD2 is used for head-mounted displays (HMDs), glasses, etc. for displaying "XR" such as VR (Virtual Reality), AR (Augmented Reality), MR (Mixed Reality), SR (Substitutional Reality), etc. It is a type of other wearable AR device that is attached and projected onto a lens or retina (hereinafter, simply referred to as "HMD").

The HMD2 includes a display means, an audio output means, and a position acquisition means.
Among these, the display means is a liquid crystal display (Liquid Crystal Display), an organic EL (Organic EL) or an OLED (Organic light-emitting diode) display, a micro LED array, a MEMS laser projector, and other retinal projection type displays. In the present embodiment, an example in which two left and right display means are provided so that stereoscopic viewing is possible will be described.
The audio output means include headphones, earphones, and the like, and a D / A (Digital to Analog) converter and the like. The audio output means can output the audio generated by the review device 1 so that the reviewer can hear it.
Position acquisition means include a three-dimensional acceleration sensor, a gyro, a camera, a radar, a lidar (Light Detection and Ranging, LIDAR), an infrared sensor, a GPS (Global Positioning System), and other room positioning sensors. By the position acquisition means, the HMD2 can acquire information such as the position, direction, speed, acceleration, etc. of the reviewer equipped with the position acquisition means in the three-dimensional space. The position acquisition means may be provided in the HMD2 main body. Alternatively, the position acquisition means may be separately provided in the room where the HMD2 is used as a separate device equipped with an infrared sensor or the like.

The controller 3 is a controller associated with the HMD2 and capable of detecting a position, orientation, speed, acceleration, button press, etc. in a three-dimensional space. Therefore, the controller 3 includes a plurality of buttons and pads. Further, the controller 3 includes various position acquisition means like the HMD 2.

In addition, the review device 1 can be connected to an external network such as a LAN (Local Area Network), a WAN (Wide Area Network), a short-distance network, or a mobile phone network.

(Control configuration of review device 1)
Next, the control configuration of the review device 1 will be described. The review device 1 includes a control unit 10, an image processing unit 11, a storage unit 12, an input unit 13, a display unit 14, and a connection unit 15. Each part may be connected by a common bus, or may be further connected by a dedicated bus between each part.

The control unit 10 is a control calculation unit that controls the entire review device 1. The control unit 10 may be, for example, a general CPU (Central Processing Unit), MPU (Micro Processing Unit), or the like.

The image processing unit 11 is a control calculation unit that executes image processing and the like. The image processing unit 11 may include, for example, a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or the like. Further, the image processing unit 11 may be able to perform rendering of various three-dimensional data such as Direct X (registered trademark) and Open GL standard, shader calculation, and the like at high speed. In addition, the image processing unit 11 may function as an accelerator that supports calculations such as the Ray Tracing method and the Radiosity method. Further, the image processing unit 11 may be provided with a support function for physical calculations such as structure and strength calculation. Further, the image processing unit 11 may be provided with support functions such as polygon division and normal calculation. The image processing unit 11 can execute, for example, a programmable shader.

The storage unit 12 is a non-temporary recording medium in which various data are stored. The storage unit 12 is, for example, various RAM (Random Access Memory), ROM (Read Only Memory), eMMC (embedded Multi Media Card), SSD (Solid State Drive), HDD (Hard Disk Drive), optical recording medium, or the like. .. Here, the recording medium that is accessed at high speed, such as the RAM of the storage unit 12, may be directly connected to the control unit 10.

The input unit 13 is a device for the user of the review device 1 to give various instructions. The input unit 13 is, for example, a keyboard, a mouse, a touch pad, a touch panel, a digitizer, a 3D mouse, a stereo camera, or the like.

The display unit 14 is a device that displays various data of the review device 1. The display unit 14 may be, for example, various displays such as a liquid crystal display, an organic EL or OLED display, and a micro LED display.
The input unit 13 and the display unit 14 may be configured as an integrated touch panel, digitizer, or the like.

The connection unit 15 is a connection interface for connecting to the HMD2, such as USB (Universal Serial Bus), Thunderbolt (registered trademark), wireless LAN, Bluetooth (registered trademark), and other unique interfaces. In addition to this, the connection unit 15 may include an interface for connecting to an external network.

[Control configuration of review system X]
Next, the control configuration of the review system X of the present embodiment will be described with reference to FIG.
The control unit 10 of the review device 1 of the present embodiment includes an intermediate data conversion means 100, an avatar arranging means 110, a drawing means 120, and a contact determination means 130.
The storage unit 12 includes CAD data 200, intermediate data 210, avatar data 220, and marker setting data 230.

The intermediate data conversion means 100 converts the CAD data 200 of the plant into the intermediate data 210.
In addition, the intermediate data conversion means 100 can also convert the CAD data 200 into data in the ".obf" format (hereinafter, referred to as "OBF data").

The avatar arranging means 110 arranges the reviewer's avatar in the coordinate system of the same scale as the intermediate data 210 converted by the intermediate data converting means 100. Therefore, the avatar arranging means 110 can also align the position of the avatar's hand in the virtual space with the position of the real space acquired by the head-mounted display.
Further, the avatar arranging means 110 acquires the instruction of the reviewer on the controller 3. Then, the avatar arranging means 110 can move the avatar according to the instruction of the reviewer. At this time, the avatar arranging means 110 can switch between a high-speed movement mode in which the avatar is moved at high speed and a low-speed movement mode in which the avatar is moved slower than the high-speed movement mode. In the high-speed movement mode, the avatar arranging means 110 is set so that gravity is not applied, and the avatar arranging means 110 can move in the vertical direction of the virtual space without determining the collision with the surface in the virtual space. The avatar arranging means 110 is set to apply gravity to the avatar in the low-speed movement mode. In this case, the avatar arranging means 110 aligns the position of the sole of the avatar with the position of the substantially horizontal plane that first contacts the avatar from the waist in the downward direction of the body axis in the virtual space.

The drawing means 120 draws a virtual space corresponding to the intermediate data 210 corresponding to the viewpoint position of the avatar placed by the avatar arranging means 110. The drawing means 120 causes the virtual space to be displayed on the display unit 14 and / or the display means of the HMD2.
The drawing means 120 can prevent the drawing means 120 from drawing a surface deeper than the specific threshold value corresponding to the scale of the intermediate data 210 in the field of view of the avatar.

The contact determination means 130 determines the contact between the avatar and a surface other than the substantially horizontal plane in the virtual space while the avatar is moving. For this substantially horizontal plane, for example, a surface having an angle (inclination) from −45 ° to 45 ° (hereinafter, simply referred to as “a surface having a temperature of 45 ° or less”) may be used in the direction perpendicular to gravity.
When the contact is determined, the contact determination means 130 adds a marker to the contact position of the surface in the virtual space and / or warns the reviewer by audio output.

In addition, in the present embodiment, the HMD 2 displays an image of the virtual space drawn by the drawing means 120 on the display means. Further, the HMD2 can acquire information on the position, orientation, velocity, acceleration, etc. (hereinafter, referred to as “position orientation, etc.”) in the real space (three-dimensional space) by the position acquisition means.
In addition, the controller 3 can also acquire information on button presses such as the position orientation in the real space (three-dimensional space). That is, the instruction of the reviewer can be obtained by detecting the pressing of the button of the controller 3.

The CAD data 200 is data for designing an industrial plant. In the present embodiment, the CAD data 200 is, for example, 3D CAD (Computer-Aided Design) data, which is 3D data including three-dimensional coordinates and surface coordinates of polygons. Further, the CAD data 200 may include, for example, material (texture) data of each polygon, arrangement data, other data, and the like. In addition, this arrangement data may include arrangement information when each pipe is connected.
More specifically, the CAD data 200 is in the ".obj" format, for example, excluding data that is not necessary for plant review from files in the ".DXF", ".dwg", and ".stl" formats. It is possible to use a file of data (hereinafter referred to as "OBJ data") or the like.

The intermediate data 210 is, for example, mesh data including data such as vertices, faces, colors, and textures of a plurality of polygons (polygons, faces). That is, the intermediate data 210 includes a plurality of surface data. Here, the intermediate data 210 may be binary data obtained by digitizing the mesh, data obtained by converting the binary data into a text file, or the like. The intermediate data 210 may be, for example, data in the “.obf” format (hereinafter, referred to as “OBF data”). Further, the intermediate data 210 may be divided for each object of the CAD data 200. This object may correspond to each building, each device, etc. of the plant. In addition, the object may include tools, pipes, equipment, facilities, equipment, and other collections of faces made up of polygons.

The avatar data 220 is data of an avatar, which is an object that moves in the virtual space as a reviewer's alter ego. The object of this avatar includes, for example, a polygon object of each part such as a head, a torso, a waist, an arm, and a leg, and data of a skeleton (bone) connected to these objects. Further, the avatar data 220 includes data of a linear body axis connecting the head and the lumbar region. This body axis can have the head facing up and the waist facing down. Further, the avatar data 220 also includes mode information indicating the direction of the line of sight of the avatar and the high-speed movement mode and the low-speed movement mode. Further, the avatar data 220 can attach an object such as a tool to a hand or the like. This mounting can also be added to the bone data.

The marker setting data 230 is data of a marker object indicating a location where the avatar touches in the virtual space. For this marker, for example, a polygonal character, a circular character, a flat character, or the like is set. When the avatar touches a plurality of surfaces, a plurality of marker setting data 230 can be stored. Further, the marker setting data 230 may include data such as a contacted avatar site and a contact time.

In addition to this, the marker setting data 230 includes values of various settings. These various settings include operation mode settings. The setting of this operation mode includes a setting regarding the types of the high-speed movement mode and the low-speed movement mode, the presence / absence of gravity, and the presence / absence of collision determination. Here, the high-speed movement mode is a mode in which the avatar is moved at a higher speed than the low-speed movement mode. The presence or absence of gravity is a setting of whether or not the avatar is lowered below the virtual space with an acceleration that imitates gravity. The presence or absence of collision determination is a setting related to the addition of markers, which will be described later. In the present embodiment, when the high-speed movement mode is set, for example, both gravity and collision determination are set to "none". On the other hand, in the low-speed movement mode, for example, both gravity and collision detection are set to "Yes". It is also possible to set these settings separately, switch them by pressing a button on the input unit 13, or temporarily change them.

Here, the control unit 10 of the review device 1 functions as the intermediate data conversion means 100, the avatar arranging means 110, the drawing means 120, and the contact determination means 130 by executing the control program stored in the storage unit 12. Be done. This control program includes various operating systems (OS), middleware for displaying three-dimensional graphics such as Unity (registered trademark), and application software of the present embodiment.
Further, each part of the above-mentioned review device 1 becomes a hardware resource for executing the image forming method of the present invention.
It should be noted that a part or any combination of the above-mentioned functional configurations may be configured in terms of hardware or circuit by IC, programmable logic, FPGA (Field-Programmable Gate Array) or the like.

[Review processing by review system X]
Next, the review process by the review system X according to the present embodiment will be described with reference to FIGS. 3 to 7.
In the review process of the present embodiment, the CAD data 200 of the plant is converted into the intermediate data 210 including a plurality of surface data. Then, the reviewer's avatar is placed in the coordinate system of the same scale as the converted intermediate data 210. Then, the virtual space including the intermediate data 210 is drawn corresponding to the viewpoint position of the avatar.

In the review process of the present embodiment, an example in which a space that can be rendered by three-dimensional CG (Computer Graphics) is used as a virtual space to imitate a real three-dimensional space will be described. The virtual space of this embodiment is set in the vertical (depth), horizontal, and height directions, and corresponds to the Z-axis, the X-axis, and the Y-axis, respectively. In the present embodiment, when viewed from the line-of-sight position, the Z-axis has a large numerical value from the front to the back, the X-axis has a large numerical value from the left to the right, and the Y-axis has a numerical value from the top to the bottom. An example of using a larger coordinate system is shown. In the present embodiment, the downward direction is set as the direction in which gravity is applied.
In the review process of the present embodiment, the control unit 10 of the review device 1 mainly executes the program stored in the storage unit 12 in cooperation with each unit and uses the hardware resources.
Hereinafter, the details of the review process will be described step by step with reference to the flowchart of FIG.

(Step S100)
First, the intermediate data conversion means 100 performs the CAD data acquisition process.
The intermediate data conversion means 100 displays a GUI (Graphical User Interface) menu on the display unit 14 and causes a reviewer (user) to select CAD data 200 for designing an industrial plant or the like. The intermediate data conversion means 100 loads the CAD data 200 and develops it in the RAM or the like of the storage unit 12. At this time, the intermediate data conversion means 100 may be able to convert the CAD data 200 into OBJ format data.

(Step S101)
Next, the intermediate data conversion means 100 performs the intermediate data conversion process.
The intermediate data conversion means 100 converts the CAD data 200 into the intermediate data 210.
More specifically, the intermediate data conversion means 100 performs processing such as file reading processing, mesh expansion processing, and display control processing.

In this file reading process, the intermediate data conversion means 100 uses a Unity function or the like to read, for example, a file of OBJ format data as CAD data 200 in a multi-threaded manner. That is, it is possible to read an OBJ format file divided into a plurality of object units from each thread at once. As a result, the reading processing performance can be improved.

In the mesh expansion process, the intermediate data conversion means 100 supports multithreading and expands each polygon (mesh) included in the OBJ data into a RAM or the like. As a result, the processing performance of mesh expansion can also be improved.
As for the CAD data 200 that has been read once, it is also possible to directly read the OBF format data and develop the mesh as described later.

In the display control process, the intermediate data conversion means 100 performs data conversion for polygon display control. In this data conversion, the intermediate data conversion means 100 performs object division generation, binary storage or reproduction of the generation model.
For example, in Unity, the upper limit of the number of vertices for one object is 65535. Therefore, the intermediate data conversion means 100 divides the object if the number of vertices of one object is more than 65535. As this division, the intermediate data conversion means 100 may perform processing such as dividing each plant in the CAD data 200 as an object. Further, for example, it is possible to preferentially divide a portion where polygons are separated. Further, the intermediate data conversion means 100 can convert the number of vertices to the upper limit number or less by connecting polygons and averaging them according to specific conditions. In addition, the intermediate data conversion means 100 can delete objects other than the site of the plant.
Further, the intermediate data conversion means 100 also performs polygon scale conversion, coordinate system conversion, object-based conversion, material, texture-related conversion, and the like.
Hereinafter, the intermediate data 210 that has been expanded into the RAM and subjected to these processes is simply referred to as binary data.

After that, the intermediate data conversion means 100 can store the binary data including the created object in the storage unit 12 as OBF format data in association with the CAD data 200. As a result, when the CAD data 200 is specified next time, the OBF format data can be directly read and the time required for reading can be shortened.

After that, drawing of the virtual space is executed based on this binary data expanded in RAM.

(Step S102)
Here, the avatar arranging means 110 performs the HMD information acquisition process.
In this process, the avatar arranging means 110 acquires data such as the position orientation of the HMD2.
Further, the avatar arranging means 110 acquires the information of pressing the button of the controller 3 as an instruction of the reviewer. This instruction includes, for example, a movement instruction with a button or a pad, an instruction of a high-speed movement mode or a low-speed movement mode, and the like.
Further, the avatar arranging means 110 can also acquire an instruction for automatic movement to move to a set point. This automatic movement is, for example, a function that can set a point to move to the storage unit 12 and move it to a target place in the virtual space. The setting of this point can be dynamically registered, for example, by pressing a specific button of the controller 3 at the moved place. The set point can be instructed by, for example, the reviewer selecting it from a menu or a mini-map described later.
The avatar arranging means 110 sets these instructions in the avatar data 220. That is, whether it is the high-speed movement mode or the low-speed movement mode is also set in the avatar data 220.

(Step S103)
Next, the avatar placement means 110 performs the avatar placement process.
The avatar arranging means 110 arranges the reviewer's avatar in the coordinate system of the same scale as the intermediate data 210. In the present embodiment, the avatar arranging means 110 can be arranged on the same scale by arranging the head of the avatar in the virtual space corresponding to the information such as the position orientation acquired by the HMD2. That is, the avatar arranging means 110 arranges the position and orientation of the avatar's head according to the position and orientation of the head of the reviewer in the real space.
As a result, the height in HMD2 can be matched with the height of the avatar in the virtual space. Therefore, it is possible to browse the scenery with the same feeling as the reviewer actually sees at the plant with HMD2. Furthermore, by looking at the feet with the HMD2, the height of the structure can be intuitively understood.

(Step S104)
Next, the avatar arranging means 110 determines whether or not it is in the high-speed movement mode. The avatar arranging means 110 refers to the avatar data 220 and the marker setting data 230, and determines Yes when the high-speed movement mode is set. Further, the avatar arranging means 110 determines Yes even when the automatic movement instruction is given, as in the high-speed movement mode. The avatar arranging means 110 determines No in other cases.
In the case of Yes, the avatar arranging means 110 advances the process to step S105.
If No, the avatar arranging means 110 proceeds to step S106. In this case, the movement may be performed in the low-speed movement mode.

(Step S105)
In the high-speed movement mode, the avatar arranging means 110 performs high-speed movement processing.
When the avatar arranging means 110 receives a movement instruction in the high-speed movement mode, the avatar arranging means 110 moves the avatar in the virtual space in response to the instruction in the controller 3. At this time, the avatar arranging means 110 moves at a higher speed than the low-speed movement mode.
Further, the avatar arranging means 110 moves the avatar at a high speed to the set position when instructed to move automatically. At this time, it may be moved by the shortest distance ignoring the contact with the surface, or the course (route) may be searched and moved by giving priority to the position where there is no object as much as possible.
Here, in the high-speed movement mode, the avatar arranging means 110 may be moved without performing the gravity and sole processing described below and without performing the collision determination with the surface. In addition, the avatar arranging means 110 may also move in the vertical direction according to the movement instruction of the controller 3.

(Step S106)
Here, the avatar arranging means 110 performs gravity processing.
For example, in the low-speed movement mode, when gravity is set to "Yes" in the marker setting data 230, the avatar arranging means 110 moves the avatar downward on the Y-axis with a predetermined gravitational acceleration. At this time, in order to alleviate the feeling of fear when falling from a high place, it is preferable not to exceed a specific speed.

(Step S107)
Next, the avatar arranging means 110 performs the sole processing.
For example, in the low-speed movement mode, when the collision detection is set to "Yes" in the marker setting data 230, the avatar arranging means 110 is the position of the substantially horizontal plane that first contacts the avatar from the waist in the downward direction of the body axis. In addition, by aligning the soles of the avatar's feet, it is possible to prevent them from falling from stairs, grating, etc. That is, in the reviewer's review, it is possible to go up and down the stairs without designating the stairs or the like in the intermediate data 210 one by one.

A specific example of this foot sole treatment will be described with reference to FIGS. 4 and 5.
According to FIG. 4, the avatar A is moved downward on the Y-axis, that is, dropped, as it is, as shown by the outline of the light-colored alternate long and short dash line, by the above-mentioned gravity processing.
Here, the avatar arranging means 110 extends the vector from the waist H of the avatar A in the downward direction (direction from the head to the waist H) along the body axis. In FIG. 4A, this vector is shown by a dark alternate long and short dash line. With respect to this vector, contact determination (collision determination, intersection determination) with each polygon (plane) of the intermediate data 210 is performed. Here, the avatar arranging means 110 is referred to as a "substantial horizontal plane" when the first contact surface in this collision determination is, for example, a horizontal plane including the X-axis and the Z-axis as 0 ° and a horizontal angle of 45 ° or less. to decide. In the example of FIG. 4, the vector is in contact with the substantially horizontal plane S.

On this, when the coordinates of the sole L of the avatar A in the Y-axis direction are lower than the coordinates in the Y-axis direction of the substantially horizontal plane, the avatar arranging means 110 considers that they are in contact with each other in the substantially horizontal plane. Align with the position of. In the case of this example, the avatar arranging means 110 moves the position of the avatar A upward in the Y-axis direction, and aligns the coordinates of the Y-axis of the sole L with the coordinates of the Y-axis of the substantially horizontal plane S. There is. Alternatively, the avatar arranging means 110 may move only the position of the leg portion that is below the substantially horizontal plane S in the Y-axis direction, and may be processed so as to cooperate with other joints by the physics engine.

According to FIG. 5, for example, as shown in FIG. 5A, the avatar can be located on the horizontal plane S of the stairs. Then, as shown in FIG. 5B, when the avatar A moves from the front direction to the back direction on the Z axis, a contact determination is made for the next substantially horizontal plane S. Then, as shown in FIG. 5C, by moving the avatar A upward in the Y-axis direction, it is possible to climb the stairs.

Further, by the above-mentioned gravity treatment, even if the plant falls from a position on the second floor or higher, if it comes into contact with the lower surface, it is possible to recognize the substantially horizontal plane of the lower floor and move it to the hit position. ..
In the contact determination of the vector from the waist of the avatar, when the contact is made with a surface other than a substantially horizontal plane, that is, a surface of 45 ° or more, the sole treatment may not be performed. As a result, it is possible to distinguish between the surface on which the avatar stands and the other parts, and it is possible to avoid the occurrence of immovable parts.

(Step S108)
Here, the contact determination means 130 determines whether or not the avatar has contacted with the collision determination.
The contact determination means 130 sets the marker setting data 230 and determines whether or not the collision determination is “yes”. On this basis, when the avatar moves in the virtual space in the state where the collision determination is "Yes", it is determined to be Yes when it comes into contact with a polygon (plane) other than the substantially horizontal plane treated by the sole of the foot. Here, the contact determination means 130 may determine contact with an object such as a tool worn by the avatar in addition to the head, body, arms, legs, and the like of the avatar. This makes it possible to know where the interference occurs during manufacturing and maintenance. Further, the contact determination means 130 determines No when the avatar is not in contact with the polygon.

FIG. 6A shows an example in which the moved avatar A comes into contact with one of the surfaces of the object O.

In the case of Yes, the contact determination means 130 advances the process to step S109.
If No, the contact determination means 130 advances the process to step S110.

(Step S109)
When the contact is determined, the contact determination means 130 performs the marker addition process.
When the contact is determined, the contact determination means 130 adds a marker to the contact position of the surface in the virtual space.
The contact determination means 130 adds the added marker as an object to the marker setting data 230. At this time, the contact determination means 130 can add markers by color-coding each object such as a body part of the avatar and a tool. Further, the contact determination means 130 can, for example, set the number of stored items and add a plurality of the contact determination means 130 to the marker setting data 230.
When the number of stored items is exceeded, the contact determination means 130 can be erased from the old marker.
Further, the contact determination means 130 can add the time when the marker is added, the movement (trajectory) of the avatar at that time, and the like to the marker setting data 230 as data.
In addition, the contact determination means 130 can write out the position (coordinates) of the marker stored in the marker setting data 230 to the CAD data 200 and output it.

FIG. 6B shows an example of this marker addition. In such a case, the contact determination means 130 arranges the marker M at the central portion of the contacted portion so as to be the surface of the surface. Although FIG. 6B shows an example in which the marker M has a star shape, it may be a simple sphere or the like.

Further, the contact determination means 130 can output a buzzer or a low-pitched hit sound from the HMD 2 at the time of contact determination, and notify the reviewer by voice output. Further, the contact determination means 130 can be notified not only by voice but also by vibration of the controller 3.

(Step S110)
Here, the drawing means 120 performs the drawing process.
The drawing means 120 draws binary data, which is intermediate data 210 developed in the RAM and executed various processes, as a virtual space corresponding to the viewpoint position of the avatar.

At this time, the drawing means 120 can execute various programmable shaders to adjust the vertices and drawing.
Specifically, the drawing means 120 can be configured so as not to draw a surface deeper than the specific threshold value corresponding to the scale of the intermediate data 210 in the field of view of the avatar. That is, the rendered distance (depth) can be set variably.
Therefore, for example, the drawing means 120 can execute the processing of the vertex shader or the pixel shader in which the coordinates in the depth direction of the polygon to be drawn are variable. In these shaders, the drawing means 120 can be set so as to make it difficult to draw a polygon whose depth in the viewpoint direction of the avatar is deeper (farther) than a specific threshold value. This specific threshold value can be calculated and set, for example, as the scale of the intermediate data 210, from the number of polygons displayed, the load of the image processing unit 11 and the storage unit 12, the distance required for verification directly on the plant site, and the like. Is. Alternatively, the drawing means 120 can specify conditions such as when the viewpoint of the avatar is rotated to shorten (reduce) the specific threshold value and reduce the number of polygons displayed.

As a method of making it difficult to draw polygons on the back side of the rendered distance, the drawing means 120 performs processing such as not drawing polygons, reducing the number of polygons or making them billboarded, displaying points, and fog. It is possible to perform processing such as performing.
Here, the drawing means 120 can make it possible to confirm what is in the direction of an object having polygons that are difficult to draw, such as displaying characters like "** facility". .. At this time, when there are many objects of the installed equipment, the drawing means 120 can display the area name such as "plant A, plant B, raw material tank yard, manufacturing equipment" instead of the equipment name. ..

As shown in the screen example 500 of FIG. 7A, the drawing means 120 can perform drawing corresponding to the display means of the HMD2. In addition to this, the drawing means 120 can also be displayed on the display unit 14. This allows the reviewer to verify the plant as if it were seen in an actual industrial plant.

Further, the drawing means 120 can also draw a map in which the intermediate data 210 is arranged in the virtual space.

As shown in the screen example 501 of FIG. 7B, this map may be displayed on the HMD2 as a mini-map at all times, or may be displayed as a map of the entire screen. In this screen example 501, plant A and plant B are shown as large objects O, the position of avatar A is indicated by an icon, and the direction of the line of sight is indicated by an arrow. This allows the reviewer to easily see where they are in the virtual space. Further, in the map of the entire screen, by designating the moving point P and instructing it by operating the button of the controller 3, as described above, it is possible to immediately move to that position in the high-speed moving mode.

Further, the drawing means 120 can also draw a bird's-eye view image to be displayed on the display unit 14. At this time, the drawing means 120 can draw an avatar object on the bird's-eye view image, and draw a mini-map on it in a semi-transparent manner. That is, the avatar object may not be drawn for HMD2, but may be drawn in the bird's-eye view image displayed on the display unit 14. In this bird's-eye view image, the viewpoint, the line-of-sight direction, and the like can be instructed from the input unit 13 and the like.

(Step S111)
Next, the drawing means 120 determines whether or not to end the review. When the drawing means 120 detects that the reviewer has instructed the end of the review by the controller 3 or the input unit 13, it determines Yes. The drawing means 120 determines No in other cases.
In the case of Yes, the drawing means 120 ends the review process.
If No, the drawing means 120 returns the process to step S102 and continues drawing for review.
As described above, the review process according to the first embodiment of the present invention is completed.

With the above configuration, the following effects can be obtained.
Conventionally, although the technique of Patent Document 1 can assist in the design of piping, it has not been possible to evaluate (review) the maintainability of the actually designed plant.
Therefore, even if the CAD data 200 is displayed and reviewed by CAD software, it is difficult to grasp it intuitively.

On the other hand, the review device 1 according to the embodiment of the present invention is a review device for reviewing an industrial plant, and the CAD data 200 of the plant is converted into intermediate data 210 including a plurality of surface data. The intermediate data conversion means 100 to be converted, the avatar placement means 110 for arranging the reviewer's avatar in the coordinate system of the same scale as the intermediate data 210 converted by the intermediate data conversion means 100, and the avatar placed by the avatar placement means 110. It is characterized by including a drawing means 120 for drawing a virtual space corresponding to the intermediate data 210 from the viewpoint position of the above.
With this configuration, it is possible to read the 3D CAD data file and intuitively review the piping of the plant in the plant design. As a result, it is possible to intuitively review the virtual space from the viewpoint of the avatar just by preparing the CAD data 200. As a result, it is possible to perform simulations of various adjustments such as experience of maintenance space and operation simulation during operation. Therefore, the design can be shortened and the cost can be reduced.

Further, conventionally, in order to make the CAD data 200 viewable by XR or the like, it has been necessary to request a manufacturer or the like to manually convert the data for XR or the like.
On the other hand, the review device 1 according to the embodiment of the present invention displays an image of the virtual space drawn by the drawing means 120, is connected to an HMD2 capable of acquiring the position and orientation of the real space, and arranges an avatar. The means 110 is characterized in that the position of the head of the avatar in the virtual space is aligned with the position and orientation of the real space acquired by the HMD2.
By configuring in this way and drawing the virtual space after converting to the intermediate data 210, it is not necessary to manually convert the CAD data 200 by the manufacturer or the like. Therefore, the CAD data 200 can be viewed as it is by XR or the like. Therefore, when the CAD data 200 is modified or changed, it can be reviewed immediately.

Further, in order to make the CAD data 200 viewable by XR or the like, it is necessary to set the stairs or the like on the CAD data 200. On top of this, it was necessary to ask the manufacturer or the like to reposition the stairs or the like so that the data could be manually moved up and down like a passage.
On the other hand, in the review device 1 according to the embodiment of the present invention, the avatar arranging means 110 is located at a position on a substantially horizontal plane where the avatar arranging means 110 first contacts the avatar from the waist to the downward direction of the body axis in the virtual space. It is characterized by aligning the soles of the feet.
With this configuration, it is possible to move the avatar or the like up and down on the CAD data 200 without setting the stairs or the like so as not to fall from the gap between the stairs. That is, it is not necessary to modify the CAD data 200. Therefore, the CAD data 200 can be viewed as it is by XR or the like.

Further, in the review device 1 according to the embodiment of the present invention, whether or not the avatar arranging means 110 acquires the instruction of the viewer and applies gravity to the avatar, and / or whether or not the avatar is in the high-speed movement mode for moving the avatar at high speed. In the case of setting that does not apply gravity or in the high-speed movement mode, it is characterized in that it can move in the vertical direction of the virtual space without determining the contact with the surface in the virtual space.
With this configuration, it is possible to easily move the avatar in the virtual space according to the intention of the reviewer. Also, even in the real space, the possibility of hitting a wall or the like when the reviewer moves can be reduced. Therefore, by automatically turning off unnecessary collision detection, the processing load can be lightened, and the burden of avoiding the user can be lightened to improve usability.
Furthermore, by setting the movement method in the virtual space to two modes, a high-speed movement mode and a low-speed movement mode, even a reviewer who operates for the first time can operate it intuitively. Then, it becomes possible to quickly move to the desired place in the virtual space. Furthermore, by making it possible to move without gravity, it becomes possible to easily move to a high position in the virtual space.

Further, the review device 1 according to the embodiment of the present invention is further provided with a contact determination means 130 for determining contact between the avatar and a surface other than the substantially horizontal plane in the virtual space while the avatar is moving. do.
With this configuration, the result of contact determination between the avatar and the surface of an object such as a wall or device can be easily grasped. Therefore, it is possible to easily know where the interference occurs during manufacturing and maintenance. In other words, it is possible to easily verify a situation in which a hand or head hits the plant while moving around the plant at the actual size.
In addition, in the high-speed movement mode, it is possible to prevent the reviewer from interfering with the instruction and movement of the avatar by not performing the contact determination.

Further, in the review device 1 according to the embodiment of the present invention, when the contact determination means 130 determines the contact, a marker is added to the contact position of the surface in the virtual space, and / or by voice output. It is characterized by warning the reviewer.
With such a configuration, it is possible to confirm the contact even afterwards, and it becomes easy to verify.
Further, in the high-speed movement mode, it is possible to prevent unnecessary markers from being added by not adding markers.

Further, the review device 1 according to the embodiment of the present invention is connected to the controller 3 capable of acquiring the position and orientation in the real space, and the avatar arranging means 110 sets the position of the avatar's hand in the virtual space by the HMD2. The contact determination means 130 determines the contact with the surface in the virtual space even for the tool virtually held by the avatar's hand according to the acquired position in the real space.
With this configuration, it is possible to grasp the interference of objects such as tools worn by the avatar.

Further, the review device 1 according to the embodiment of the present invention is characterized in that the drawing means 120 does not draw a surface deeper than a specific threshold value corresponding to the scale of the intermediate data 210 in the field of view of the avatar.
By configuring the image processing range to be limited as needed in this way, even a large-scale intermediate data 210 can be smoothly displayed, and the display performance can be improved.

In the first embodiment described above, when the intermediate data 210 is expanded into binary data, the display control process for controlling the display of polygons is mainly executed by the intermediate data conversion means 100 of the control unit 10. explained.
Regarding this, it is also possible to optimize the processing when reading the OBJ format data or the OBF format data by using the image processing unit 11 and using a compute shader or the like, or using multithreading or the like. Further, the drawing means 120 can also be drawn at high speed by the image processing unit 11. Further, the image processing unit 11 can optimize the generation model displayed as binary data (Triangle Strips, etc.) and the drawing in the depth direction.

In the first embodiment described above, a vector is lowered from the waist of the avatar along the body axis to determine contact with a substantially horizontal plane.
However, it is also possible to extend the vector downward in the Y-axis direction to determine the contact regardless of the body axis. In this case, for example, the position of the waist of the avatar is determined as the position of 1/2 of the height of the avatar. That is, the contact may be determined by lowering the vector in the downward direction in the Y-axis direction from the height of 1/2 of the height of the avatar. Then, when the contact determination between this vector and the surface is performed, it is not necessary to directly determine the contact with the polygon or the like of the "sole" of the avatar. As a result, it is possible to determine that the avatar is in a substantially horizontal plane regardless of the posture of the avatar, and it is possible to reduce the possibility of stepping off the stairs or the like.
Furthermore, it is also possible to set the vector to extend from a position below the lumbar region. That is, it is possible to adjust the starting point of this vector to be smaller than 1/2 of the height of the avatar, for example, below the knee.
In addition, in the above-described first embodiment, although it is described that the contact determination is performed at the point of the vector, it is also possible to perform the contact determination in a circular range. As a result, even if there is a structure such as grating, it is possible to surely prevent the avatar from falling.
Further, the contact determination between the entire polygon below the waist of the avatar and another polygon or the like may be performed. In this case, if the avatar is in contact with another polygon or the like, the position of the sole of the avatar may be determined to be above the polygon.

In the above-described first embodiment, although it is described that the contact determination is not performed on the surface having an angle of 45 ° or more by the sole treatment, the contact determination may be performed either diagonally or vertically. This makes it possible to climb even diagonal slopes, pipes, slopes, and the like.
In addition, it can be configured to automatically recognize handrails and rattals in the horizontal direction, and to recognize that it is a surface of stairs with textures and materials.

In the first embodiment described above, it is described that the switching between the high-speed movement mode and the low-speed movement mode and the presence / absence of gravity are linked. However, only the presence or absence of gravity may be set separately from the mode switching.
In this case, for example, the avatar arranging means 110 can switch the presence or absence of gravity by the button of the controller 3.
Further, it is also possible to provide a plurality of controllers 3 and switch to, for example, a low-speed movement mode when the button of the controller 3 held in the right hand is pressed, and a high-speed movement mode when the button of the controller 3 held in the left hand is pressed. Is.
Alternatively, it can be configured to move in the high-speed movement mode or the low-speed movement mode depending on the pressing of a specific button or pad.

In the first embodiment described above, the drawing means 120 is described so as not to draw a surface deeper than the specific threshold value corresponding to the scale of the intermediate data 210 in the field of view of the avatar.
Regarding this, a configuration in which the specific threshold value itself is changed is also possible. For example, when the amount of polygons in the intermediate data 210 is large, that is, in the case of a crowded plant, a specific threshold value can be set closer to the front in the field of view of the avatar. On the contrary, when the amount of polygons in the intermediate data 210 is small, that is, in the case of a vacant plant, the specific threshold value can be set deeper. Alternatively, the scale itself of the plant may be changed without changing the specific threshold value to give a more perspective, and as a result, the amount of polygons to be drawn may be adjusted and the amount of processing may be adjusted.

<Second embodiment>
Next, the review system Y according to the second embodiment of the present invention will be described.
In this embodiment, when reviewing an industrial plant, it is possible to perform verification using objects such as buildings and tools. Furthermore, it is possible to verify lighting, speakers, and the like.

Specifically, as described with reference to FIG. 8, the review system Y of the present embodiment includes a review device 1b, an HMD2, and a controller 3 having the same hardware configuration as the review device 1 of the first embodiment. In the following, the same reference numerals as those in the first embodiment indicate the same components.

The control unit 10b includes an intermediate data conversion means 100, an object arranging means 111, a drawing voice means 121, and a course setting means 140.
The storage unit 12b stores CAD data 200, intermediate data 210, object data 221 and course data 240.
Hereinafter, a configuration different from the review system X of the first embodiment will be described.

The object arranging means 111 arranges the object for review in the coordinate system of the same scale as the intermediate data 210 converted by the intermediate data conversion means 100.
Further, the object arranging means 111 can acquire the instruction of the reviewer and add and / or move the object in the virtual space.
Specifically, the object arranging means 111 can arrange a sound source and / or a lighting fixture as an object, for example, in a virtual space.

The drawing voice means 121 has the same function as the drawing means 120 of the first embodiment. In the present embodiment, the drawing voice means 121 draws a virtual space corresponding to the object arranged by the object arranging means 111 and the intermediate data 210.
In addition to this, the drawing voice means 121 can also refer to the course data 240 and draw a virtual space along the set tour course.
Further, the drawing voice means 121 can draw the lighting when the lighting fixture is arranged.
In addition, when the sound source is arranged, the drawing sound means 121 can also output the sound corresponding to the sound source from the HMD2. That is, the drawing voice means 121 can calculate the output of the voice from the sound source as the virtual voice in the virtual space. As a result, the drawing voice means 121 functions as the drawing means and the voice calculation means of the present embodiment.

The course setting means 140 sets a tour course in the virtual space.
The course setting means 140 sets the course data 240 according to the user's instruction. Alternatively, the course setting means 140 can automatically calculate the course from the intermediate data 210 and set it in the course data 240.

The object data 221 is data in which an object operated by the reviewer is set. This object includes, for example, a set of tools, pipes, devices, facilities, equipment, and other faces composed of polygons. Specifically, the device includes an engine, various devices carried in from the outside, and a scaffold on which the facility is installed. This makes it possible to verify the installation in the plant. As equipment, sound source objects such as speakers, lighting fixture objects, and other objects such as wiring can be arranged.
Further, the object may be decomposed and deformed into a plurality of objects. That is, in the case of a device or the like, it can be partially disassembled or deformed. Therefore, a special object such as a tool may be set. Further, the object data 221 may include the same data as the avatar data 220 of the second embodiment described above.

The course data 240 is data in which a course for a reviewer's tour is set. Specifically, the course of the route to move in the intermediate data 210, the time to stop, and the like are set.

Here, the control unit 10b of the review device 1b functions as the intermediate data conversion means 100, the object arranging means 111, the drawing voice means 121, and the course setting means 140 by executing the control program stored in the storage unit 12b. Be made to. The use of hardware resources and the like are the same as in the first embodiment.

[Review processing by review system Y]
Next, the review process by the review system Y according to the present embodiment will be described with reference to FIG.
In the review process of this embodiment, the CAD data 200 of the plant is converted into the intermediate data 210. Then, the object for review is placed in the coordinate system of the same scale as the converted intermediate data 210. On this, a virtual space including the arranged object and the intermediate data 210 is drawn. The drawn image of the virtual space is displayed on the HMD2.
In the review process of the present embodiment, the control unit 10b of the review device 1b mainly executes the program stored in the storage unit 12b in cooperation with each unit and uses the hardware resources.
Hereinafter, the details of the review process will be described step by step with reference to the flowchart of FIG.

(Step S200)
First, the intermediate data conversion means 100 performs the CAD data acquisition process. This process is the same as in step S100 of FIG.

(Step S201)
Next, the intermediate data conversion means 100 performs the intermediate data conversion process. This process is also the same as in step S101 of FIG.

(Step S202)
Next, the course setting means 140 performs the course setting process.
The course setting means 140 sets a tour course in the virtual space and stores it in the course data 240.
The course setting means 140 sets the course according to the instruction of the user, or automatically calculates the course and sets it in the course data 240. The course setting means 140 can calculate, for example, a course that can be viewed by the reviewer for each object of the intermediate data 210 by using the traveling salesman problem or the like.

According to FIG. 10 (a), the reviewer shows an example in which the course is set to the course data 240. In this example, the object of plant A is moved to the object of plant B.

(Step S203)
Here, the object arranging means 111 performs the object arranging process.
The object arranging means 111 arranges the object for review in the coordinate system of the same scale as the intermediate data 210. The calculation of the coordinate system of the same scale as the intermediate data 210 is performed in the same manner as the process of step S103 of FIG.

The object arranging means 111 can acquire the instruction of the reviewer from the controller 3 and change the object of the object data 221. As this change, the object arranging means 111 can add or move an object in the virtual space. For example, the object arranging means 111 can arrange, disassemble, or deform a tool, a pipe, a device, an equipment, a facility, or an object composed of polygons at a specific position. At this time, the object arranging means 111 can arrange a sound source and / or a lighting fixture as an object, for example, in a virtual space.

According to the screen example 502 of FIG. 10A, the reviewer can also view the illumination by the lighting fixture I shown in the range of the alternate long and short dash line, and can confirm the spread of the sound from the sound source U. ..
According to the screen example 503 of FIG. 10B and the screen example 504 of FIG. 10C, the reviewer can decompose the object O with an icon such as an avatar wrench.

(Step S204)
Next, the drawing voice means 121 performs drawing processing. This process is also performed in the same manner as the process in step S109 of FIG.

(Step S205)
Next, the drawing audio means 121 performs audio output processing.
When a sound source is arranged in the virtual space as an object, the drawing voice means 121 outputs the voice corresponding to the sound source from the HMD2.

(Step S206)
Next, the drawing voice means 121 determines whether or not to end the review. When the drawing voice means 121 detects the instruction to end the review, it determines Yes. The drawing voice means 121 determines No in other cases.
In the case of Yes, the drawing voice means 121 ends the review process.
If No, the drawing voice means 121 returns the process to step S203 and continues drawing for review.
This completes the review process according to the second embodiment of the present invention.

With the above configuration, the following effects can be obtained.
Conventionally, XR has not been used for plant design such as piping review and equipment layout planning. Therefore, for example, when executing the review, while displaying the 3D CAD data 200 on a large screen, the piping position, the operability of the valve, and the like have been examined. In this case, the reviewer who is accustomed to handling 3D CAD can understand the sense of distance and the sense of size. However, unfamiliar reviewers have the problem that they cannot get a concrete image just by looking at it on the screen.

On the other hand, the review system Y of the present embodiment is a review system for reviewing an industrial plant, and is intermediate data that converts the CAD data 200 of the plant into intermediate data 210 including a plurality of surface data. An object arranging means 111 for arranging an object for review in a coordinate system of the same scale as the conversion means 100 and the intermediate data 210 converted by the intermediate data conversion means 100, and an object and intermediate data arranged by the object arranging means 111. It is characterized by including a drawing audio means 121 for drawing a virtual space corresponding to 210, and an HMD 2 for displaying an image of the virtual space drawn on the drawing audio means 121.
With this configuration, it is possible to review the plant with XR by HMD2. With the XR, it is possible to move the actual size plant, and it is possible to check the maintainability, operability, aisle width, etc. from the viewpoint of an actual worker.

Further, the review device 1b according to the present embodiment further includes a course setting means 140 for setting a tour course in the virtual space, and the drawing voice means 121 is characterized in that the virtual space along the tour course is drawn. ..
With this configuration, it is possible to set a tour course in the XR data. This allows you to tour without going to the actual plant.

Further, the review device 1b according to the present embodiment is characterized in that the object arranging means 111 acquires the instruction of the reviewer and adds and / or moves the object in the virtual space.
With this configuration, it is possible to move and add objects in the XR. Therefore, it becomes possible to plan the installation of temporary scaffolding. In addition, heavy machinery such as cranes can be placed to plan the layout of construction work. In addition, it will be possible to simulate operations using tools, plan modifications to piping, and so on.

Further, the review device 1b according to the present embodiment is characterized in that the object arranging means 111 acquires the instruction of the reviewer and decomposes the object unit by unit in the virtual space.
With this configuration, it is possible to disassemble the XR object. Therefore, it can be used for checking the maintenance space and learning the disassembly procedure.

Further, in the review device 1b according to the present embodiment, the object arranging means 111 arranges a sound source and / or a lighting fixture as an object in the virtual space, and the drawing sound means 121 illuminates when the lighting fixture is arranged. The HMD2 is characterized in that, when a sound source is arranged, the sound corresponding to the sound source is also output.
With this configuration, it is possible to install a sound source in the plant and verify the installation location of the broadcasting equipment and the sound source. Alternatively, it is possible to check the noise emitted from the device. Furthermore, by installing lighting equipment, it is possible to check the arrangement and number of lighting from the perspective of an actual worker.

<Other embodiments>
The above-mentioned first embodiment and the second embodiment are merely examples, and this combination and some of the embodiments can be performed arbitrarily. For example, the configuration may include the first embodiment and the second embodiment at the same time. The object data 221 may include the avatar data 220. Further, the avatar may be moved in the course data 240.
Further, in the above-described first embodiment and the second embodiment, an example of XR display using HMD2 has been described. However, a configuration may be configured in which only the display unit 14 is used and HMD2 is not used. In this case, only the bird's-eye view image may be displayed, or the start point image from the avatar may be displayed on the display unit 14. Further, the configuration may not use the controller 3. In this case, various processes may be executed by the input unit 13.

Further, it is needless to say that the configuration and operation of the above-described embodiment are examples and can be appropriately modified and executed without departing from the spirit of the present invention.

1, 1b Review device 2 HMD
3 Controller 10, 10b Control unit 11 Image processing unit 12, 12b Storage unit 13 Input unit 14 Display unit 15 Connection unit 100 Intermediate data conversion means 110 Avatar placement means 111 Object placement means 120 Drawing means 121 Drawing voice means 130 Contact determination means 140 Course setting means 200 CAD data 210 Intermediate data 220 Avatar data 221 Object data 230 Marker setting data 240 Course data 500, 501, 502, 503, 504 Screen example A Avatar H Waist I Lighting equipment L Foot M Marker O Object P Point S Horizontal plane U sound source X, Y review system

Claims (10)

A review device for reviewing industrial plants
An intermediate data conversion means for converting CAD data of a plant into intermediate data including a plurality of surface data,
An avatar placement means for placing a reviewer's avatar in a coordinate system of the same scale as the intermediate data converted by the intermediate data conversion means,
A review device including a drawing means for drawing the intermediate data as a virtual space corresponding to the viewpoint position of the avatar placed by the avatar placement means. A head-mounted display that displays the image of the virtual space drawn by the drawing means and can acquire the position and orientation of the real space is connected.
The avatar placement means is
The review device according to claim 1, wherein the position of the head of the avatar in the virtual space is aligned with the position and orientation of the real space acquired by the head-mounted display. The avatar placement means is
The review device according to claim 1 or 2, wherein the position of the sole of the avatar is aligned with the position of the substantially horizontal plane that first contacts the avatar from the lumbar region in the downward direction of the body axis in the virtual space. .. The avatar placement means is
Obtain the instruction of the reviewer, set whether or not to apply gravity to the avatar, and / or whether or not to move the avatar at high speed in the high-speed movement mode.
Claim 1 is characterized in that, in the case of the setting where gravity is not applied or in the high-speed movement mode, it is possible to move in the vertical direction of the virtual space without determining the collision with the surface in the virtual space. The review device according to any one of 3 to 3. The invention according to any one of claims 1 to 4, further comprising a contact determination means for determining contact between the avatar and a surface other than the substantially horizontal plane in the virtual space while the avatar is moving. Review device. The contact determination means is
When contact is determined, a marker is added to the contact position of the surface in the virtual space, and / or
The review device according to claim 5, wherein the reviewer is warned by audio output. A controller that can acquire the position and orientation of the real space is connected,
The avatar placement means is
The position of the avatar's hand in the virtual space is aligned with the position of the real space acquired by the head-mounted display.
The contact determination means is
The review device according to claim 5 or 6, wherein the tool virtually held in the hand of the avatar also determines the contact with the surface in the virtual space. The drawing means
The review device according to any one of claims 1 to 7, wherein a surface deeper than a specific threshold value corresponding to the scale of the intermediate data is not drawn in the field of view of the avatar. A review system that includes a review device for reviewing industrial plants and a head-mounted display.
An intermediate data conversion means for converting CAD data of a plant into intermediate data including a plurality of surface data,
An avatar placement means for placing a reviewer's avatar in a coordinate system of the same scale as the intermediate data converted by the intermediate data conversion means,
A drawing means for drawing a virtual space including the intermediate data corresponding to the viewpoint position of the avatar placed by the avatar placement means, and a drawing means.
A review system including a head-mounted display that displays an image of the virtual space drawn on the drawing means. A review method performed by a review device for reviewing industrial plants,
Convert the CAD data of the plant to intermediate data including multiple surface data,
Place the reviewer's avatar in the coordinate system of the same scale as the converted intermediate data,
A review method characterized in that the intermediate data is drawn as a virtual space corresponding to the viewpoint position of the avatar.

Images