KR101871764B1 - Industrial infrastructure management platform building system based on virtual reality - Google Patents

Abstract

The present invention relates to a virtual reality-based facility management platform construction system that realizes an industrial site by realizing facilities as a virtual reality and realizes management of industrial site information by utilizing virtual reality space information.
The virtual reality-based facility management platform construction system according to the present invention is a virtual reality-based facility management platform construction system that enables facilities installed in an industrial site to be constructed as a virtual reality-based platform, A panorama image acquisition unit 161 for acquiring a panorama image of a facility in an industrial site and registering the panorama image in the database 170; An image processor 162 for converting the panorama image acquired through the panorama image acquiring unit 161 into image data for building a virtual reality platform; A VR location information processing unit 163 for calculating location information of facility data processed through the image processing unit 162 and mapping the location information to a portal map, a floor plan and an indoor image of the facility to register the VR platform, And a management platform construction server 100 to provide more systematic and efficient management of facilities in an industrial field through virtual reality space information.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual reality-based facility management platform construction system,

The present invention relates to a facility management platform construction system, and more particularly, to a virtual reality-based facility for realizing industrial real estate by realizing facilities as virtual reality, And a management platform construction system.

Various facilities are installed and operated in the industrial field. The facilities of these industrial sites are operated with various monitoring devices installed due to their complicated structure and operation and many risk factors. Such industrial facility monitoring devices include a CCTV camera for capturing facility images, a temperature sensor and a pressure sensor for detecting the temperature and pressure of the facility, and a gas sensor for detecting leakage of gas and explosive substances. The surveillance signals of these surveillance devices are transmitted to the central control center and monitored by the supervisor in real time.

However, it is difficult to grasp the structure of the industrial site at a glance, and it is difficult to grasp the exact state of the facility where the abnormality occurs in the remote central control center even when the abnormality occurs in the facility. . In addition, even when the facility is returned to an industrial site for repairing the facility due to an abnormality, there is a problem that it takes much time to locate and check the facility where the abnormality occurs. On the other hand, such facility surveillance is usually carried out by skilled managers. It takes a lot of time and money to discharge the skilled worker at the industrial site, Experts were lacking.

Korean Registered Patent No. 10-1152239 (registered May 25, 2012)

The present invention has been proposed in order to solve the problems of facilities management in the conventional industrial site. The object of the present invention is to construct facility information of an industrial site as a virtual reality including location information, Based facility management platform system that enables the virtual reality to be realized.

In order to achieve the above object, a system for building a virtual reality-based facility management platform according to the present invention includes a virtual reality-based facility management platform for building facilities installed on an industrial site as a virtual reality- A panorama image acquisition unit for acquiring a panorama image of a facility in an industrial site to be installed and registering the panorama image in a database; An image processor for converting the panoramic image acquired through the panoramic image acquisition unit into data for constructing a virtual reality platform; And a VR location information processing unit configured to calculate location information of facility data image-processed through the image processing unit, to map the portal map, a floor plan of the facility, and an indoor image and register the VR platform to construct a VR platform .

Here, the image processing unit may include an image distribution module that distributes and arranges panoramic images of the facilities according to the positions of the captured images, a sphere image generation module that generates the sphere images by synthesizing the distributed images, A mosaic / blur processing module for mosaicing and blurring the sphere image for protection, an image correction module for correcting image color, brightness or sharpness, and a camera tripod or dron image displayed at the bottom of the image A cube conversion module for converting an image into a cube type image, a duplication module for each size for duplicating an image according to a terminal resolution or a network environment, and a watermark processing A watermark processing module for use And a tiling processing module for dividing the panoramic image so as to output a partial image for each field of view.

Meanwhile, the VR position information processing unit includes a portal map first position calculation module for calculating a position of a facility by designating a facility position on a portal map provided by the portal map server, An indoor floor plan map mapping module for mapping an indoor floor plan of the facility on the calculated portal map; a floor plan calculation unit for calculating a location of the VR data as an internal facility by designating an arrangement location of the indoor facilities on the indoor floor plan map mapped to the portal map A floor plan VR data mapping module for mapping the VR data calculated from the position through the floor plan secondary position calculation module to an indoor floor plan; and a VR data mapping module for mapping the VR data mapped on the indoor floor plan through the floor plan VR data mapping module. And a VR data location information registering module for registering the location information of the data in the database.

In addition, the VR position information processing unit is provided with a VR data orientation for performing a directional correction of VR data by designating a reference direction of VR data whose position is calculated through a planar secondary position calculation module, A correction module is provided.

In addition, the VR location information processing unit may include a VR data facility location and operation module that performs an operation on the location coordinates of the designated sub-facilities by designating the location of the sub-facilities on the indoor VR data screen, A VR data facility mapping and an information registration module for mapping and registering the detailed facilities, which are located through the location designating and calculating module, on the indoor photographic VR data screen and registering the information of the detailed facilities in the database.

On the other hand, it is preferable that the VR points corresponding to the facility to be designated are designated by drag-and-drop through the mouse, on the portal map, the indoor floor plan, and the indoor photographic VR data screen.

The system for constructing a facility management platform based on virtual reality according to the present invention is constructed by combining facility information of complex and various industrial sites with location information of a portal map to construct a virtual reality, So that it can be managed effectively and efficiently. In addition, education and learning of facilities in industrial sites can be realized through virtual reality space information, so that it is possible to enhance understanding of facilities without visiting the site directly.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram of a network connection diagram of a virtual reality-based facility management platform construction system according to the present invention;
2 is a block diagram of a facility management platform construction server according to the present invention.
3 is a block diagram of an image processing unit provided in a facility management platform construction server according to the present invention;
4 illustrates an example of a sphere image generated through the sphere image generation module according to the present invention,
FIG. 5 illustrates an example of a cube image transformed through the cube transformation module according to the present invention,
6 is a view illustrating an example of panoramic photographs divided through the tiling processing module according to the present invention,
7 is a block diagram of a location information processing unit provided in a facility management platform construction server according to the present invention;
FIG. 8 is a view showing an example of a manager screen in which a portal map position of a facility is calculated through a portal map primary position calculation module according to the present invention,
9 shows an example of VR points displayed on a portal map according to the present invention,
10 is a diagram showing an example of a screen in which an indoor floor plan is mapped to a portal map according to the present invention,
11 is a diagram showing an example of a screen in which positions of respective VR points are calculated on an indoor floor plan according to the present invention,
12 illustrates an example of a VR data mapping screen on a plan view according to the present invention,
13 is a diagram illustrating a screen for arranging and operating indoor facilities through the VR data facility location and calculation module according to the present invention,
FIG. 14 is a flowchart illustrating a process of establishing a facility management platform through a facility management platform establishment server according to the present invention; FIG.
FIG. 15 is a diagram illustrating a screen for displaying the entire structure and information of a facility provided through the VR platform constructed according to the present invention in one screen,
16 is a diagram showing an example of the appearance of a facility provided through the VR platform constructed according to the present invention,
17 is a view illustrating an indoor photographic image of a facility provided through a VR platform constructed according to the present invention,
FIG. 18 is a view showing a floor plan of a room in an indoor photographic image provided through a VR platform constructed according to the present invention,
FIG. 19 illustrates an example of a screen for displaying facility information arranged in an indoor shot image provided through a VR platform constructed according to the present invention,
FIG. 20 shows an example of an HMD interlocking screen provided through a VR platform constructed according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram illustrating an overall network connection diagram of a virtual reality-based facility management platform construction system according to an embodiment of the present invention.

As shown in FIG. 1, the virtual reality-based facility management platform construction system receives portal map location information of each area from a portal map server 200 that provides location information through a map of a portal site And a facility management platform construction server 100 for mapping the location information of the facility installed in the industrial site with the facility information and constructing the facility management platform as a virtual reality platform.

The portal map server 200 is a server system for providing a portal map service such as an internet portal site or a portal site such as Naver or Google. In the present invention, the location of the facility is determined using a portal map provided by the portal map server 200 Registered on the portal map.

 The facility management platform establishing server 100 registers the location of the facilities on the portal map using the portal map provided by the portal map server 200 and maps the internal facilities to the position information on the floor plan and the indoor shot image, It is a server computer built and provided as a reality. In the embodiment of the present invention, the facility management platform establishing server 100 processes the panorama image photographed outside and inside of facilities in an industrial site, calculates position information on the image processing facility, Map, indoor floor plan and indoor photographic image to create and present a virtual reality for the facilities in the industrial field.

2 is a block diagram of a facility management platform construction server according to an embodiment of the present invention.

2, the facility management platform construction server 100 according to the present invention includes an input unit 120 and an output unit 130 for inputting and displaying data, and a communication unit 130 for communicating with an external computer system through a network An interface unit 150 for transmitting and receiving data to and from an external peripheral device, a VR building engine 160 for processing panoramic images of facilities and building virtual reality data, A database 170 in which data to be processed through the controller 160 is stored, and a central control unit 110 for controlling operations of the respective units.

The central control unit 110 is an apparatus for controlling and managing each component of the facility management platform construction server 100. The central control unit 110 is provided with a general central processing unit (CPU), a random access memory (RAM) ), And software for recognizing and operating the hardware device, so as to control the overall operation of the facility management platform establishing server 100.

The VR construction engine 160 is a program for constructing a virtual reality environment by image processing of a facility image of an actual industrial site. The VR construction engine 160 is provided with a panorama image acquiring unit 160 for acquiring a panorama image of a facility in an industrial site, An image processing unit 162 for performing image processing to construct an image obtained through the panoramic image obtaining unit 161 as VR data; And a VR position information processing unit 163 for calculating information and displaying it on a map.

The data processed through the VR construction engine 160 is stored in the database 170. The database 170 stores a panoramic image obtained by the panoramic image acquisition unit 161, A VR location information DB for storing VR data constructed through the VR location information processing unit 163; and a VR location information DB for storing the VR location information.

Hereinafter, the process of constructing the VR data through the VR building engine 160 provided in the facility management platform building server 100 will be described in detail.

First, the panorama image acquisition unit 161 is a program module that captures a panorama image of a facility through a camera and stores the panorama image in a database 170. The panorama image acquisition unit 161 acquires panorama image of an external panorama The image of the facility to be constructed as a virtual reality such as an image and an inner panorama image is acquired in the form of a panorama image.

The image processing unit 162 is a program module for converting the panoramic image obtained through the panoramic image obtaining unit 161 into VR data for constructing a virtual reality, and FIG. 3 is a block diagram of the image processing unit will be.

3, the image processing unit 162 according to the present invention includes an image distribution module 20 for distributing and arranging panoramic images for facilities, a sphere image generation unit for generating a sphere image by synthesizing the distributed images, A module 21, a mosaic / blurring module 22 for mosaicing and blurring the sphere image, an image correction module 23 for correcting the color or the like of the image, a floor image A cube conversion module 25 for converting an image into a cube image, a copying module 26 for each size copying the image by size, a watermark processing module 27 for performing watermark processing on the image, A tiling processing module 28 for performing a tiling process on the image, and a verification and registration module 29 for checking the final processed image and registering the final processed image in the database 170.

The image distribution module 20 is a program module for arranging and distributing panoramic images of the facilities according to the positions of the captured images. The spherical image generation module 21 uses the distributed images through the image distribution module 20 It is a program module that generates a sphere image. In the embodiment of the present invention, the spear image generation module 21 generates a spear image using a stitching tool, and Fig. 4 shows an example of such a spear image.

The mosaic / blurring processing module 22 is a program module for mosaicing an image and performing hidden processing on sensitive data, such as security facilities, in order to protect an individual's privacy invasion, The bottom image change module 24 is a program module for correcting color, brightness, sharpness, and the like. The panorama image changing module 24 processes the tripod portion included in the lower part of the image by using a logo or a floor pattern, It is a program module which processes the dron part displayed at the bottom or top of the image in the logo or sky pattern during shooting. In addition, the cube conversion module 25 is a program module for converting the corrected image into a cube-type image, and FIG. 5 shows an example of a cube conversion image according to an embodiment of the present invention.

The copying module 26 for each size is a program module for generating panorama images of various sizes according to the resolution or network environment of each user terminal. The watermark processing module 27 is a program for displaying copyright or the like in the form of watermark Module, and the tiling processing module 28 is a program module for dividing a panoramic photograph so as to output a partial image for each user's view. 6 shows an example of a panorama photograph divided through the tiling processing module.

The inspection and registration module 29 is a program module for finally checking the final processed facility image through the above process and registering it in the database 170. The inspection process is performed through the administrator, If it is found that an error has occurred, the process returns to the process and the process of processing the image is performed again.

The location information processing unit is a program for constructing a VR platform by calculating location information of a facility image imaged through the image processing unit 162 and mapping the map information on a map. FIG. 7 is a block diagram of a location information processing unit according to an embodiment of the present invention. FIG.

7, the location information processing unit according to the present invention includes a portal map primary position calculation module 30 for calculating a position on a portal map of the entire facility, A floor plan secondary position calculation module 32 for calculating the position of each facility on the floor plan, and a floor plan secondary position calculation module 32 for designating a reference direction of each facility VR data A floor plan VR data mapping module 34 for mapping VR data of each facility on the floor plan, a VR data location information registration module 35 for registering the location information of VR data, A VR data facility location specifying and calculating module 36 for specifying and calculating the location of the facility on the VR data, The VR data facility map information and the registration module 37 to register the information is provided.

The portal map first position calculation module 30 is a program module for calculating where facilities of an industrial site to be constructed in a virtual reality environment are located on a portal map, An example of an administrator screen in which a portal map position is calculated. As shown in FIG. 8, when the administrator loads a portal map provided by the portal map server 200 through the VR data construction page, and designates the location of the facility on the portal map as a VR point (hotspot), the designated VR The position of the point is automatically calculated. FIG. 9 shows an example of VR points displayed on the portal map. The VR point position calculation on the portal map is provided in the portal map.

The indoor floor plan view portal map mapping module 31 is a program module for mapping and registering an indoor floor plan of a facility to a portal map position where a position of a VR point is calculated through a portal map primary position calculation module 30, An indoor floor plan is mapped to a portal map.

11 is a block diagram illustrating an example of a screen on which a position of each VR point is calculated on a plan view, . As shown in FIG. 11, when a point is dragged and dropped on a plan view, position information on the corresponding VR point is calculated and displayed.

The VR data orientation correction module 33 is a program module for correcting the orientation information for the VR points whose positions are calculated on the plan view. The VR data orientation correction module 33 is a program module that correlates the directionality of each VR points, And the like. For example, in order to achieve this object, the VR data direction correcting module 33 specifies the reference direction (true north) of the VR data and registers it in the register .

The plan view VR data mapping module 34 is a program module for mapping each VR data on a plan view. The plan view VR data mapping module 34 is a program module for mapping the VR data VR data is mapped on the floor plan and registered. FIG. 12 shows an example of a VR data mapping screen on the plan view. In FIG. 12, the position of each VR data, for example, the electric room, the equipment inlet, the generator room, the machine room, the air conditioning room, the warehouse 1, . The position information of the VR data registered in the plan view through the plan view VR data mapping module 34 is finally verified through the VR data position information registration module 35 and registered in the database 170.

The VR data facility location and calculation module 36 is a program module for arranging the indoor sub-facilities on the indoor VR data screen corresponding to the floor plan mapping the VR data and calculating the arranged locations, The designation and operation module 36 arranges the reference points according to the location of the indoor detailed facilities on the indoor photographic VR data screen through drag-and-drop. When the location is selected, And displayed. FIG. 13 shows an example of a screen for arranging and operating the indoor facilities through the VR data facility location and calculation module 36. FIG.

The VR data facility mapping and information registration module 37 is a program module for registering indoor facilities that have been selected and computed on the indoor photographic VR data screen and registering detailed information on the registered facilities, The mapping and information registration module 37 provides the name, type, type, attachment sensor, and control device information of the indoor facilities so that they can be registered and inquired.

Hereinafter, a process of establishing a virtual reality-based facility management platform through the facility management platform establishing server 100 having the above configuration will be described.

14 is a flowchart illustrating a process of establishing a facility management platform through a facility management platform establishment server according to an embodiment of the present invention.

Step S100: First, in order to construct a facility management platform based on a virtual reality (VR), a panorama image of the exterior and interior of a facility to be constructed is photographed through a camera. The photographed panoramic image is registered in the database 170 via the panorama image acquisition unit 161 provided in the VR construction engine 160 of the facility management platform construction server 100.

Step S110: The panorama image acquired through the panorama image acquisition unit 161 of the VR construction engine 160 is registered in the database 170 via the image processing unit 162 through the image processing process. The image processing for the panoramic image is finalized through panoramic image distribution, sphere image generation, mosaic and blurring processing, image correction, floor image modification, cube conversion, size replication, watermark processing, tiling processing, (170).

Step S120: After the image processing of the panoramic image of the facility is performed, in order to express the image based on the virtual reality, first, the facility location on the portal map is designated and calculated, and the indoor floor plan of the facility is displayed on the calculated portal map And registers them.

Steps S130 and S140: When the indoor floor plan of the facility is mapped on the portal map, the position of the indoor facility to be arranged on the indoor floor plan is calculated and the VR data of the indoor facility is mapped and registered on the indoor floor plan (S130). In this process, orientation correction is performed on the VR data so that the directionality of each VR data can be interlocked. The location information of the VR data mapped to the indoor floor plan is registered in the database 170 (S140).

Step S150: When the VR data is mapped on the indoor floor plan, the location of the detailed facility is designated to arrange the indoor detailed facilities on the indoor photographic VR data screen corresponding to the indoor floor plan, and the calculation is performed on the designated position coordinates . This location designation is made through dragging and dropping the detailed facility registration through the mouse.

Step S160: When the location designation and operation are performed for the detailed facilities, the detailed facilities are mapped to the corresponding locations, and detailed information of the detailed facilities is registered, and the indoor detailed facilities are finally registered on the indoor photographic VR data screen.

When the VR platform is implemented by mapping the portal map, the indoor floor plan, the indoor photographic VR data, and the facility information through the above process, the implemented VR platform allows the administrator to view the entire structure, information, A photographed image, detailed facility information arranged in a facility room, and the like can be confirmed based on a virtual reality. FIG. 15 shows an example of a screen for displaying the entire structure and information of a facility provided through the constructed VR platform in one screen, and FIG. 16 shows an example of a screen for displaying the appearance of the facility. 18 shows an example of a screen for displaying a floor plan of a room in an indoor photographic image. FIG. 19 shows an example of a screen for displaying indoor plan images of facilities An example of a screen for displaying information is shown. 15 to 19, detailed information about the facility is displayed by clicking an icon or number, which is a VR point displayed on the screen.

Meanwhile, the VR platform is interlocked with various terminal devices such as a PC, a mobile device, an HMD and the like, and is operated so as to perform a variety of interactive operations such as changing of view and selection through a mouse, a controller, a gyro sensor, Screen. Also, the VR platform can output the facility information and the like linked to the photographing screen by using Augmented Reality (AR).

As described above, the facility management platform construction system according to the present invention realizes the facility management on the basis of the virtual reality by providing the facility information of the industrial site by implementing the virtual reality including the location information. It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention as defined by the appended claims and their equivalents. It is a matter of course that a deformation can be made.

100: Facilities management platform build server
110: central control unit 120: input unit
130: output unit 140: communication unit
150: interface unit 160: VR building engine
161: Panorama image acquisition unit 162:
20: Image distribution module 21: Spear image generation module
22: Mosaic / blurring processing module 23: Image correction module
24: Floor image change module 25: Cube conversion module
26: replication module by size 27: watermark processing module
28: tiling processing module 29: verification and registration module
163: VR position information processing unit 30: Portal map first position calculation module
31: indoor floor plan portal map mapping module 32: floor plan secondary position calculation module
33: VR data orientation correction module 34: top view VR data mapping module
35: VR data location information registration module
36: VR data facility location and calculation module
37: VR Data Facility Mapping and Information Registration Module
170: Database
200: Portal Map Server

Claims (6)

delete A panorama image acquisition unit 161 that acquires a panorama image of a facility in an industrial site to be installed and registers the acquired panorama image in a database 170, An image processor 162 for converting the data of the facility data processed by the image processor 162 into data for constructing a real platform, and the location information of the facility data imaged through the image processor 162 is mapped to a portal map, a floor plan of the facility, A facility management platform construction server (100) having a VR location information processing unit (163) for constructing a VR platform,
The image processing unit 162 of the facility management platform construction server 100
An image distribution module 20 for distributing and arranging panoramic images of facilities according to the positions of the captured images, a spherical image generation module 21 for generating spherical images by synthesizing the distributed images, A mosaic / blurring processing module 22 for mosaicing and blurring the sphere image for image processing, an image correction module 23 for correcting image color, brightness or sharpness, a camera tripod or drones A cube conversion module 25 for converting an image into a cube-type image, and a replication module for each size to copy the image according to the terminal resolution or the network environment 26), a watermark processing module (27) for performing watermark processing to display authorship on an image, Which divides the panoramic image processing to output the partial images by tiling processing module (28), a virtual reality-based facility management platform to build the system, it characterized in that the two offers.
A panorama image acquisition unit 161 that acquires a panorama image of a facility in an industrial site to be installed and registers the acquired panorama image in a database 170, An image processor 162 for converting the data of the facility data processed by the image processor 162 into data for constructing a real platform, and the location information of the facility data imaged through the image processor 162 is mapped to a portal map, a floor plan of the facility, A facility management platform construction server (100) having a VR location information processing unit (163) for constructing a VR platform,
The VR location information processing unit 163 of the facility management platform construction server 100
A portal map first position calculation module 30 for calculating a position of a facility by designating a facility position on a portal map provided by the portal map server 200 and a positional position calculation module An indoor floor plan map mapping module 31 for mapping an indoor floor plan of the facility on the portal map for which the indoor map is calculated, and an indoor floor map mapping module 31 for specifying the arrangement location of the indoor facilities on the indoor floor plan map mapped to the portal map, A floor plan VR data mapping module 34 for mapping the VR data calculated in position through the floor plan secondary position calculation module 32 to an indoor floor plan, And a VR data location information registration module 35 for registering the location information of the VR data mapped on the indoor floor plan through the VR data mapping module 34 in the database 170 Virtual reality-based facility management platform to build the system.
The method of claim 3,
The VR position information processing unit 163
A VR data direction correcting module 33 for performing direction correcting for VR data so that the direction of each VR data can be interlocked by designating a reference direction of VR data whose position is calculated through the planarity secondary position calculating module 32 And a virtual reality-based facility management platform construction system.
The method according to claim 3 or 4,
The VR position information processing unit 163
A VR data facility location designating and calculating module 36 for designating an arrangement location of the detailed facilities on the indoor photographic VR data screen and calculating the location coordinates of the designated detailed facilities,
A VR data facility mapping and information registering unit 35 for mapping and registering detailed facilities designated by the VR data facility location and calculation module 36 on the indoor photographic VR data screen and registering the detailed facility information in the database 170, And a registration module (37) are provided in the facility management platform.
6. The method of claim 5,
The facility location designation on the portal map, the indoor floor plan, and the indoor photographic VR data screen is performed by dragging and dropping a VR point corresponding to a facility to be designated, A facility management platform building system.

Images