JP2021047623A - Management method, management device, information processing device, management system, and control program - Google Patents

Abstract

To provide a management method, a management device, an information processing device, a management system, and a control program that can efficiently manage facilities and appliances of the facilities.SOLUTION: A management method comprises: an arrangement information display step for displaying, in response to specification of a predetermined facility by a user, shape of the facility and arrangement information indicating arrangement of an appliance installed in the facility in a display unit of an information processing device used by the user; a first image display step for displaying, in response to specification of a position desired by the user based on the arrangement information, a first image showing the facility seen from an actual location corresponding to the position in the display unit together with the arrangement information; and a relevant information display step for displaying, according to an instruction from the user, relevant information including at least one of information regarding the facility and information regarding work status in the facility in the display unit together with the arrangement information and the first image.SELECTED DRAWING: Figure 6

Description

The present invention relates to a management method, a management device, an information processing device, a management system, and the like for managing a facility.

Conventionally, various management systems have been devised for managing a facility (for example, a factory) and equipment of the facility (for example, a factory production line). For example, Patent Document 1 discloses a production control system that grasps the production status associated with the production of parts with a computer in real time.

In recent years, as described in Non-Patent Document 1, a method of managing a facility and the equipment of the facility has been developed by using a three-dimensional (3D) image of the facility. Here, as for the 3D image, the 3D point cloud data of the facility is acquired by measuring the facility to be managed by using the 3D laser scanner, and the captured image and the 3D point cloud obtained by imaging the facility are obtained. It can be created by aligning with the data and then associating with the data.

By using this three-dimensional image, it is possible to easily examine the arrangement of equipment and simulate the loading / unloading route of goods / devices.

Japanese Unexamined Patent Publication No. 2006-39946

"InfiPoints", [online], [Search on September 3, 1991], Internet <URL: http://kel.co.jp/product/P000154.html>

In order to manage a facility and the equipment of the facility (for example, a production line of a factory), it is important to consider with reference to various information about the facility. However, there is room for improvement in the mechanism for allowing the user to refer to the facility and various information necessary for managing the equipment of the facility.

Even if the information is about the same facility, different types (categories) of information are often managed by different management systems. For example, information on the layout of equipment in a facility (including a three-dimensional image of the facility) is managed by a management system for facility management, and information on the purchase price of equipment installed in the facility is a system for asset management. Is managed by. For example, when checking the purchase price of all the equipment installed in the managed facility or relocating the equipment currently owned, the user accesses (logs in) each of the multiple management systems and the facility. It was inefficient because it had to refer to the information needed to manage the system.

One aspect of the present invention is to realize a management method, a management device, an information processing device, a management system, etc. that enable efficient management of a facility and equipment of the facility.

In order to solve the above problems, the management method according to the first aspect of the present invention determines the shape of the facility and the arrangement of the equipment installed in the facility according to the designation of the predetermined facility by the user. Corresponding to the arrangement information display step of displaying the indicated arrangement information on the display unit of the information processing apparatus used by the user and the position desired by the user specified based on the arrangement information. The first image display step of displaying the first image showing the facility viewed from the actual location together with the arrangement information on the display unit, and the information related to the equipment and the said according to the instruction from the user. The related information display step of displaying the related information including at least one of the information related to the work situation in the facility on the display unit together with the arrangement information and the first image is included.

According to the above configuration, the related information about the facility designated by the user is displayed on the display unit of the information processing apparatus together with the arrangement information and the first image. Here, the related information includes at least one of information related to the facility and information related to the work situation in the facility.

This makes it possible for the user to refer to the facility designated by the user and the necessary and sufficient information for managing the equipment of the facility. Therefore, the user can efficiently manage the designated facility and the equipment of the facility.

In the related information display process, the management method according to the second aspect of the present invention includes, as information related to the facility, the name of the equipment, the model number, the number of years of operation, the date of purchase, and the price at the time of purchase. At least one may be displayed on the display unit.

According to the above configuration, the user can confirm the name, model number, operating years, purchase date, purchase price, etc. of the equipment while referring to the arrangement information and the first image. Therefore, the user can manage the equipment after understanding the equipment of the facility.

In the management method according to the third aspect of the present invention, in the first or second aspect, the arrangement information includes information indicating the arrangement of one or more cameras installed in the facility, and one said by the user. Depending on the designation of the camera, the second image obtained by immediately capturing the facility by the camera may be displayed on the display unit.

According to the above configuration, the second image obtained by immediately capturing the facility by the camera designated by the user is displayed on the display unit. As a result, the user can easily check the work status in the designated facility.

In the management method according to the fourth aspect of the present invention, in the third aspect, the information indicating the camera that is capturing the second image and the information about the user who is using the second image are displayed. It may be configured to be displayed on the unit.

In order to display the second image on the display unit of the information processing device, it is necessary to distribute a large amount of data. Therefore, it is desirable to avoid the situation where many users use the second image at the same time. According to the above configuration, the user can check and manage the usage status of the second image.

In the above aspect 3 or 4, the management method according to the fifth aspect of the present invention may further include a recording step of storing the second image in response to a request from the user.

As a result, the user can use the recorded second image as a material for managing the work status in the designated facility.

In the management method according to the sixth aspect of the present invention, in any one of the first to fifth aspects, the first image is an image captured by capturing at least a part of the area of the facility and a target area including the area. It may be a three-dimensional image generated by associating with the three-dimensional point cloud data representing the three-dimensional coordinates acquired in the above.

According to the above configuration, the user can manage the designated facility after grasping the state of the designated facility three-dimensionally and accurately.

In the management method according to the seventh aspect of the present invention, in any one of the first to sixth aspects, the user specifies the arrangement information or two different positions in the first image in the related information display step. Depending on the situation, the display unit may display the distance between the actual locations corresponding to the two positions.

According to the above configuration, in the arrangement information or the first image, the distance between the actual locations corresponding to each of the two positions specified by the user is displayed on the display unit. This allows the user to easily measure the distance between two locations in an actual facility based on placement information or a first image.

The management method according to the eighth aspect of the present invention corresponds to the arrangement information or one plane in the first image specified by the user in the related information display step in any one of the first to seventh aspects. Therefore, a cross-sectional view with the plane as the cut surface may be displayed on the display unit.

According to the above configuration, in the arrangement information or the first image, a cross-sectional view with a plane designated by the user as a cut surface is displayed on the display unit. This allows the user to more accurately grasp information about the inside of the equipment in the actual facility and the space hidden by the equipment.

In order to solve the above problems, the management device according to the ninth aspect of the present invention includes a communication unit and a management control unit, and the communication unit is used to collect data between the information processing device used by the user. The management control unit transmits and receives information indicating the facility designated by the user from the information processing apparatus, and in response to the reception of the information indicating the facility, the shape of the facility and the equipment installed in the facility. The arrangement information indicating the arrangement is distributed to the information processing device, and the information indicating the position desired by the user specified by the user based on the arrangement information is received from the information processing device. A first image showing the facility viewed from an actual location corresponding to the position is delivered to the information processing apparatus, and is related to the equipment in response to receiving a request from the user from the information processing apparatus. The related information including at least one of the information to be processed and the information related to the work status in the facility is delivered to the information processing apparatus.

According to the above configuration, the management device distributes the facility layout information, the first image, and the related information to the information processing device used by the user. As a result, the user can refer to the information necessary and sufficient for managing the designated facility by using the information processing device. Therefore, the user can efficiently manage the designated facility and the equipment of the facility.

In order to solve the above problems, the information processing apparatus according to the tenth aspect of the present invention includes a control unit and a display unit, and the control unit responds to the designation of a predetermined facility by the user. Arrangement information indicating the shape of the facility and the arrangement of the equipment installed in the facility is displayed on the display unit, and the position desired by the user is specified based on the arrangement information. A first image showing the facility as seen from an actual location corresponding to the above is displayed on the display unit together with the arrangement information, and in response to an instruction from the user, information related to the facility and a work situation in the facility. The related information including at least one of the information related to the above is displayed on the display unit together with the arrangement information and the first image. According to the above configuration, the same effect as that of the above aspect 1 is obtained.

In order to solve the above problems, the management system according to the eleventh aspect of the present invention includes at least a management device and an information processing device connected to the management device via a communication line. , In response to the designation of a predetermined facility by the user, the layout information indicating the shape of the facility and the layout of the equipment installed in the facility is received from the management device, and the display unit of the information processing device. The management device receives a first image showing the facility as seen from an actual location corresponding to the position according to the position desired by the user being specified based on the arrangement information. The information is displayed on the display unit together with the arrangement information, and the related information including at least one of the information related to the equipment and the information related to the work status in the facility is managed in response to the instruction from the user. It is received from the device and displayed on the display unit together with the arrangement information and the first image. According to the above configuration, the same effect as that of the above aspect 1 is obtained.

The management device and the information processing device according to each aspect of the present invention may be realized by a computer, and in this case, the computer is operated as each part (software element) included in the management device and the information processing device. A management device for realizing the management device and the information processing device by a computer, a control program for the information processing device, and a computer-readable recording medium on which the information processing device is recorded are also included in the scope of the present invention.

According to one aspect of the present invention, it is possible to efficiently manage the facility and the equipment of the facility.

It is the schematic which shows the structural example of the management system which concerns on one aspect of this invention. It is a block diagram which shows an example of the configuration of the management server. It is a functional block diagram which shows an example of the configuration of the management server. It is a block diagram which shows an example of the structure of an information processing apparatus. It is a functional block diagram which shows an example of the structure of a camera. It is a figure which shows an example of the processing flow in a management system. It is a figure which shows an example of the flow of the process concerning the use of a captured image. It is a figure which shows an example of the process flow concerning the use of a moving image. It is a figure which shows an example of the process flow concerning use of equipment guide information. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus. It is a figure which shows an example of the screen display in an information processing apparatus.

[Embodiment 1]
Hereinafter, one embodiment of the present invention will be described in detail.

(Outline of management system 100)
The management system 100 that employs the management server 1 (management device) according to the present invention collectively presents various information necessary for managing the facility and the equipment of the facility, and manages the facility and the equipment of the facility. It is a system that improves efficiency.

Here, the "facility" refers to an arbitrary space to be managed regardless of the presence or absence of a building, and examples thereof include a factory, a construction site, a construction site, an office, and a building. “Facility equipment” is equipment installed in an arbitrary space to be managed, and examples thereof include various devices, wiring, piping, workbenches, shelves, cabinets, and office desks. The “facility equipment” may also include free space reserved in the facility for accommodating parts and pre-shipment products.

In the following, in order for a company having a base office 5, a plurality of offices 3, and a plurality of factories 4 (facility) to manage each factory 4 and various devices 41 (equipment) installed in the factory 4. , The case where the management system 100 is introduced will be described as an example.

In FIG. 1, various devices 41a and various devices 41b are described according to the factory 4 in which the various devices 41 are installed. In this specification, when various devices 41a and various devices 41b are not distinguished, they are simply referred to as "various devices 41".

(Outline configuration of management system 100)
First, the schematic configuration of the management system 100 will be described with reference to FIG. FIG. 1 is a schematic view showing a configuration example of a management system 100 according to an aspect of the present invention.

The management system 100 includes a base office 5, a plurality of offices 3, and a plurality of factories 4. Each will be described below.

In FIG. 1, the plurality of business establishments 3 are referred to as business establishments 3a and 3b, and the plurality of business establishments 4 are referred to as factory 4a and factory 4b. In this specification, when the establishment 3a and the establishment 3b are not distinguished, it is simply described as "factory 3", and when the factory 4a and the factory 4b are not distinguished, it is simply described as "factory 4".

<Base office 5>
The base office 5 includes a management server 1. The base business establishment 5 may be a business establishment having a head office function, or may be one of the business establishments 3 described later. For example, the business establishment to which the person in charge of maintenance and management of the management server 1 belongs may be the base business establishment 5.

The management server 1 is a computer that functions as a server, and has functions that the computer normally has. The management server 1 may be a cloud server. The management server 1 is communicably connected to the information processing device 30 of each business establishment 3 and the camera 40 installed in the factory 4 via the communication network 7 (communication line). The business establishment 3 is a business establishment 3 to which a user who is permitted to use the management system 100 belongs.

In this specification, when the information processing device 30a and the information processing device 30b are not distinguished, they are simply referred to as "information processing device 30".

<Business office 3>
The office 3 is an office for carrying out work other than the work carried out at the factory 4. The work performed at the business establishment 3 includes the planning and determination of measures for making the work performed at the factory 4 more efficient. In planning and deciding such measures, for example, it is necessary to consider relocation and renewal of equipment, grasp the working status of workers working in the factory 4, and the like.

A LAN (local area network) (hereinafter referred to as "business office LAN") is arranged in the business establishment 3. The office LAN is communicably connected to the communication network 7. The information processing device 30 may be directly connected to the external communication network 7, and the office LAN is not an essential configuration of the management system 100.

An information processing device 30a used by each business employee (user) belonging to the business establishment 3a for daily business is connected to the business office LAN of the business establishment 3a so as to be able to communicate. The information processing device 30a may be installed at the place of business 3a or may be carried by each employee. Further, the information processing device 30a may be one unit or a plurality of units.

An in-house LAN is also provided in the office 3b, and an information processing device 30b used by each employee belonging to the office 3b for daily work is connected so as to be able to communicate. The information processing device 30b may be installed at the place of business 3b, or may be carried by each employee. Further, the information processing apparatus 30b may be one unit or a plurality of units.

Typical examples of the information processing device 30a and the information processing device 30b are a personal computer, a tablet terminal, a smartphone, and the like. The information processing device 30a has functions such as a communication function with another device, a data input function such as a keyboard, and a data display function such as a monitor.

<Factory 4>
The factory 4 is a facility that is subject to management by a user who uses the management system 100, or a facility that has various devices 41 that are subject to management by a user who uses the management system 100.

A LAN (hereinafter referred to as "factory LAN") is arranged in the factory 4. The factory LAN is communicably connected to the communication network 7. The camera 40 may be directly connected to the external communication network 7, and the factory LAN is not an essential configuration of the management system 100.

The camera 40a installed in the factory 4a is communicably connected to the factory LAN of the factory 4a. In addition, various devices 41a may be connected to the factory LAN of the factory 4a. The number of cameras 40a and various devices 41a may be one or a plurality.

(Configuration of management server 1)
First, the configuration of the management server 1 will be described with reference to FIGS. 2 and 3. FIG. 2 is a block diagram showing an example of the configuration of the management server 1, and FIG. 3 is a functional block diagram showing an example of the configuration of the management server 1.

As shown in FIG. 2, the management server 1 includes a communication unit 11, a storage unit 2, and a management control unit 12.

The communication unit 11 functions as a network interface that can be connected to the communication network 7.

The storage unit 2 stores various computer programs read by the management control unit 12, data used in various processes executed by the management control unit 12, and the like. Specifically, the storage unit 2 stores captured image data 21, 3D point cloud data 22, layout data 23, 3D image data 24, various device information 25, and user information 26.

The configuration of the management control unit 12 and the storage unit 2 of the management server 1 will be described in more detail with reference to FIG.

The captured image data 21 is image data generated based on a captured image in which at least a part of the area of the factory 4 is captured in advance from the camera 40 installed in the factory 4. For example, the captured image data 21 is an image obtained by processing an captured image (spherical image) captured by a 3D camera using an arbitrary well-known technique. The captured image data 21 includes captured images for each factory 4.

The 3D point cloud data 22 is three-dimensional point cloud data representing three-dimensional coordinates obtained by scanning at least a part of the area of the factory 4 with a 3D laser scanner. The 3D point cloud data 22 includes 3D point cloud data for each factory 4. The 3D point cloud data 22 can be obtained by any well-known method.

The layout data 23 is layout information indicating the shape of the factory 4, the layout of the cameras 40 and various devices 41 installed in the factory 4. The layout data 23 may include information indicating the positions of the camera 40 and the various devices 41, identification information given to each of the cameras 40, names of the various devices 41, and the like. The layout data 23 may be, for example, a layout diagram including information on the arrangement such as the positions of the walls and pillars of the factory 4.

The 3D image data 24 is generated by associating an captured image obtained by capturing at least a part of a region of the factory 4 with 3D point group data representing three-dimensional coordinates acquired for a target region including the region. It is a 3D image (first image). In addition, in this specification, "3D" is intended as "three-dimensional". Further, the "3D image" is an image having a stereoscopic effect expressed on a plane.

The various device information 25 is information related to the various devices 41 installed in each of the factories 4. The various device information 25 includes information on the name, model number, purchase date, operating years, inspection and repair history of each of the various devices 41 installed in each of the factories 4, information on the purchase price, and the like. You may be.

The user information 26 is data of a set of a user name and a password of each user registered as a user of the management system 100. Here, the "user name" may be a user's name or identification information (for example, a user ID) given to each user. The "password" may be, for example, a character string arbitrarily set by the user. The user information 26 may be any information for identifying and approving a user who uses the management system 100, and is not limited to the user name and password. For example, the user information 26 may be information indicating features such as a face, an iris, a fingerprint, and a voiceprint of each user registered as a user of the management system 100.

The management control unit 12 is, for example, a CPU, and controls so as to execute processing of each function included in the management server 1. More specifically, the management control unit 12 includes a 3D point cloud data acquisition unit 120, a login reception unit 121, an image capture image correction unit 122, a 3D image synchronization processing unit 123, a distance calculation unit 124, a cross-sectional view generation unit 125, and an imaging unit. It includes an instruction unit 126 and a distribution information determination unit 127.

The 3D point cloud data acquisition unit 120 acquires and updates the 3D point cloud data 22 for each factory 4.

The login reception unit 121 collates the user name and password received from the information processing device 30 with the user name and password stored in the user information 26. As a result of the verification, if the received user name and password match the user name and password stored in the user information 26, the login reception unit 121 approves the access from the information processing device 30.

The captured image correction unit 122 processes a spherical image captured by a 3D camera into a flat image using a well-known method. For example, the captured image correction unit 122 processes a spherical image into a planar three-dimensional image by using the same expression technique as when creating a world map of the Mercator projection from a globe. The captured image correction unit 122 stores the processed image in the captured image data 21.

The 3D image synchronization processing unit 123 generates 3D image data 24 by associating the position coordinates of the pixels in the planar image processed by the captured image correction unit 122 with the three-dimensional coordinates of the corresponding positions. Specifically, the 3D image synchronization processing unit 123 calculates the position coordinates on the captured image using the camera installation position measured in advance in the captured image and the angle indicating the imaging direction, and the position coordinates and the 3D point group Align the data with the 3D coordinates before associating. The 3D image synchronization processing unit 123 may adjust the density of the associated three-dimensional coordinates according to the distance from the camera installation position. For example, the 3D image synchronization processing unit 123 roughly associates the three-dimensional coordinates with each other for the image at a position far from the camera installation position, and the three-dimensional coordinates with respect to the image at the position close with the camera installation position. Closely correspond. By generating the 3D image data 24 in this way, it is possible to reduce the data size of the 3D image data 24. Therefore, it is possible to reduce the burden in various processes using the 3D image data 24.

The distance calculation unit 124 calculates the shortest distance between the two points (that is, the distance in the horizontal direction) based on the information indicating the two points specified by the user in the layout diagram or the 3D image. Specifically, when two points in the three-dimensional image are specified, the distance calculation unit 124 calculates the vertical distance (that is, the difference in height), the horizontal distance, and the shortest distance between the two points. calculate.

The cross-sectional view generation unit 125 generates a cross-sectional view with a plane designated by the user as a cut surface. Specifically, the cross-sectional view generation unit 125 generates a cross-sectional view with the plane as the cut surface based on the information indicating the plane specified by the user in the layout view or the 3D image.

The imaging instruction unit 126 instructs the camera 40 designated by the user to start imaging, change the imaging direction, stop imaging, and the like.

The distribution information determination unit 127 determines and distributes the information to be distributed to the information processing device 30 in response to various requests received from the information processing device 30. The information to be delivered to the information processing apparatus 30 may include moving image data captured by the camera 40 selected by the user.

(Configuration of Information Processing Device 30)
Subsequently, the configuration of the information processing device 30 will be described with reference to FIG. FIG. 4 is a block diagram showing an example of the configuration of the information processing device 30.

The information processing device 30 is a personal computer, a tablet terminal, a smartphone, or the like used by a user belonging to the business establishment 3 for daily work. The information processing device 30 includes a control unit 310, an operation input unit 311, a communication unit 312, a display unit 313, and a storage unit 320.

The communication unit 312 functions as a network interface that can be connected to the communication network 7.

The storage unit 320 stores various computer programs read by the control unit 310, data used in various processes executed by the control unit 310, and the like. Specifically, the management application 321 is stored in the storage unit 320. The management application 321 is a computer program for the information processing apparatus 30 to execute a function related to the use of the management system 100.

The control unit 310 is, for example, a CPU, and controls so as to execute processing of each function included in the information processing device 30. For example, the control unit 310 transmits the information input by the user to the management server 1. Further, the control unit 310 causes the display unit 313 to display various information distributed from the management server 1.

(Configuration of camera 40)
Subsequently, the configuration of the camera 40 will be described with reference to FIG. FIG. 5 is a block diagram showing an example of the configuration of the camera 40.

The camera 40 is a digital camera or a digital video camera installed on the ceiling or wall of the factory 4 or in the vicinity of various devices 41. The camera 40 includes a communication unit 411, a control unit 410, a drive unit 412, and an imaging unit 413.

The communication unit 411 functions as a network interface that can be connected to the communication network 7.

The control unit 410 controls the drive unit 412 and the image pickup unit 413 in response to an instruction from the management server 1. Further, the control unit 410 immediately outputs the captured image (or moving image) to the management server 1 via the communication unit 411.

The drive unit 412 is a mechanism for controlling the direction in which the camera 40 takes an image. The drive unit 412 changes the direction in which the image pickup unit 413 faces according to the control signal from the control unit 410.

The image pickup unit 413 is a main part of the camera 40, and includes an optical system such as a lens and an aperture.

(Flow of processing performed by the management system 100)
Subsequently, the main processing flow performed by the management system 100 will be described with reference to FIG. 6 with reference to the screen display examples shown in FIGS. 10 to 20.

When the management application 321 is started in the information processing device 30 according to the user's instruction, the information processing device 30 displays the login screen as shown in FIG. 10 on the display unit 313 and prompts the input of the user name and password. ..

[Login screen]
FIG. 10 is an example of a login screen for prompting the user to enter a user name (or user ID) and a password. On this login screen, the user inputs the user name (or user ID) "xxxxxx" and the password registered in advance in the management system 100. Note that FIG. 10 shows an example in which "factory management system" is displayed as the name of the management system.

Returning to FIG. 6, in response to the click of the login button B1 (see FIG. 10) by the user, the control unit 310 accepts the login operation (step S301), and the input user name and password are sent to the management server 1. Send to.

The login reception unit 121 of the management server 1 collates the user name and password received from the information processing device 30 with the user name and password stored in the user information 26. When the received user name and password match the user name and password stored in the user information 26, the login reception unit 121 approves the login of the user (step S101). The login reception unit 121 transmits an approval notice notifying the information processing device 30 that the login has been approved.

The various device information and layout diagrams in the factory 4 may contain information that should be kept secret from outsiders. Therefore, it is desirable that the "factory management system" be available only to users who meet predetermined conditions or play a specific role.

The control unit 310 of the information processing apparatus 30 that has received the approval notification from the management server 1 causes the display unit 313 to display the factory selection screen as shown in FIGS. 11 to 13 (step S302).

[Factory selection screen]
11 and 12 are examples of factory selection screens for allowing the user to select a desired factory. If you have factories not only in Japan but also overseas, you may first let the user select "domestic factory" or "overseas factory". For example, FIG. 11 shows a factory selection screen when "domestic factory" is selected by the user, and FIG. 12 shows a factory selection screen when "overseas factory" is selected. In FIG. 11, factories J1 to factories J7 in Japan are displayed, and in FIG. 12, factories W1 to factories W8 overseas are displayed.

On the factory selection screen, a factory in which data such as captured image data, 3D point cloud data, and various device information is not registered in the management server 1 may be displayed in a mode different from that of other factories. This is effective for notifying the user that the management system by the management system 100 is not prepared. For example, the factories J3 and J5 in FIG. 11 and the factories W2 and W6 in FIG. 12 are shown to be factories in which various data are not registered.

FIG. 13 shows a display example when "factory J1" is clicked by the user in FIG. As shown in FIG. 13, when "factory J1" is selected by the user, the building owned by the factory J1 may be displayed and the user may be allowed to select it. In the example shown in FIG. 13, the management system by the management system 100 is established in the building A where the process A of the factory J1 is performed and the first floor of the building B where the process B is performed. The management system by the management system 100 is not maintained on the floor.

Returning to FIG. 6, the control unit 310 accepts the operation of selecting the factory by the user (step S303), and transmits the layout data request of the factory specified by the user to the management server 1. In the following display screen example, a case where "Building A" of "Factory J1" is designated by the user will be described as an example.

In response to receiving the layout data request, the distribution information determination unit 127 of the management server 1 distributes the layout data of the designated factory J1 building A to the information processing device 30 which is the transmission source of the layout data request. (Step S102).

The control unit 310 of the information processing device 30 causes the display unit 313 to display the layout diagram of the A building of the factory J1 as shown in FIG. 14 based on the layout data distributed from the management server 1 (step S304: arrangement). Information display process). In the displayed layout diagram, the user can specify a desired position as the viewpoint position VP.

[Layout screen]
FIG. 14 is an example of a screen displaying the layout diagram of “Building A” of “Factory J1” based on the layout data. In the example shown in FIG. 14, in addition to the devices M1 to M10 and the workbenches T1 to T5, the doorway E and the pillars C1 to C5 are shown.

The device M3 and the device M4 are placed on the workbench T2, and the device M7 is placed on the workbench T3. Other devices shall be tall and rest on the floor.

In the following, a case where the viewpoint position VP shown in FIG. 14 is specified by the user will be described as an example.

Returning to FIG. 6, when the control unit 310 accepts the designated operation of the viewpoint position VP (step S305), the control unit 310 transmits a 3D image data request to the management server 1. The 3D image data request includes information indicating the position (coordinates) of the viewpoint position VP specified by the user.

In response to receiving the 3D image data request, the distribution information determination unit distributes the 3D image when viewed from the designated viewpoint position VP to the information processing device 30 that transmits the 3D image data request ( Step S103).

The control unit 310 displays the distributed 3D image on the display unit 313 together with the layout diagram (step S306: first image display step).

As a result, the control unit 310 displays a 3D image showing the inside of the "building A" of the "factory J1" seen from the viewpoint position VP on the display unit 313 in response to the viewpoint position VP specified by the user. Can be made to.

[3D-2D display screen]
FIG. 15 is an example of a 3D-2D display screen on which the layout diagram and the 3D image are displayed. Since the layout diagram is represented two-dimensionally and the 3D image is represented three-dimensionally, in the example shown in FIG. 15, it is displayed as "3D-2D display".

The first 3D image displayed after the viewpoint position VP is specified is an image showing the appearance when facing a preset direction from the viewpoint position VP. FIG. 15 shows a 3D image of what is seen when the device M8 and the device M9 are turned from the viewpoint position VP.

As shown in FIG. 15, an indicator VA indicating the direction displayed as a 3D image and the angle of view R is displayed at the position indicating the viewpoint position VP in the layout diagram. The user can change the direction of displaying as a 3D image by operating the indicator VA.

FIG. 16 shows an example of a 3D-2D display screen when the indicator VA is operated by the user. FIG. 16 is displayed as a 3D image of what is seen when facing the workbench T2 from the same viewpoint position VP as in FIG. In this way, the indicator VA can change the direction to be displayed as a 3D image from the viewpoint position VP to a desired direction.

Here, an example is shown in which a 3D image that can be seen from a position where the height of the viewpoint position VP from the floor is fixed (for example, 160 cm) is displayed, but the present invention is not limited to this. For example, the configuration may be such that the user can specify the viewpoint position VP and the height of the viewpoint. Alternatively, the configuration may be such that the user is allowed to operate the indicator VA to indicate the height of the desired viewpoint.

As shown in FIGS. 15 and 16, the function menu button L and the function button group K may be displayed on the 3D-2D display screen.

<Function menu button L>
First, the function menu button L will be described with reference to FIG. FIG. 17 is a diagram showing an example of a display screen when the function menu button L is clicked by the user.

The function menu button L is a button for presenting various functions to the user and allowing the user to select a desired function. Functions presented to the user include "distance measurement between two points", "cross section creation", "equipment information list", "layout change", "help", and "return to top page".

The "distance measurement between two points" is a function of displaying the distance between the actual positions indicated by each of the two points specified by the user in the layout diagram and the 3D image. When the "distance dimension between two points" is selected, as shown in FIG. 18, the control unit 310 displays the line segment connecting the two points on the layout diagram and the 3D image, and displays the positions of the two points. The indicated information is transmitted to the management server 1. The distance calculation unit 124 calculates the distance between the actual positions indicated by each of the two points based on the information indicating the positions of the two received points. The distribution information determination unit 127 distributes information indicating the calculated distance to the information processing device 30. The control unit 310 causes the display unit 313 to display information indicating the received distance. The user can easily measure the distance between two points in an actual facility based on a layout diagram or a 3D image.

In the example shown in FIG. 18, "straight line distance: 5.36 m", "horizontal direction: 4.66 m", and "vertical direction: 2.65 m" are displayed for the 3D image, and "vertical direction: 2.65 m" is displayed for the layout diagram. "Straight line distance: 4.66 m" is displayed.

"Cross-section creation" is a function of displaying a cross-sectional view with a plane P designated by the user as a cut surface in a layout drawing and a 3D image. When "Cross-section creation" is selected, as shown in FIG. 19, the control unit 310 displays a display Q for allowing the user to specify the plane P and a cross-sectional view R having the designated plane P as the cut surface. At the same time as displaying it, information indicating the plane is transmitted to the management server 1. The cross-sectional view generation unit 125 generates a cross-sectional view with the plane as a cut surface based on the information indicating the received plane. The distribution information determination unit 127 distributes the information indicating the generated cross-sectional view to the information processing device 30. The control unit 310 causes the display unit 313 to display information indicating the received cross-sectional view. The plane P specified by the user may be shown in the layout drawing. By referring to the cross-sectional view R, the user can more accurately grasp the information about the inside of the various devices 41 in the actual factory 4 and the space hidden by the various devices 41.

The "equipment information list" is a function of displaying information (related information) related to each device together with a layout diagram and a 3D image. When the "equipment information list" is selected, as shown in FIG. 20, the control unit 310 displays the device names of the devices (for example, "A device" and "B" in the vicinity of each device in the layout diagram and the 3D image. "Device", etc.) is displayed, and the equipment information list U is displayed. The equipment information list U includes at least one of the name, model number, operating years, purchase date, and purchase price of each device. Note that FIG. 20 shows an example in which the fixed asset information of the A building of the factory J1 is displayed as the equipment information list U.

"Layout change" is a function of changing the display position of the displayed layout diagram and 3D image. When "change layout" is selected, the control unit 310 replaces the display positions of the layout diagram, the 3D image, and the like in response to an instruction from the user.

"Help" is a function for providing a user with an explanation about each function menu.

"Return to top page" is a function for returning to a display screen preset as a top page. When "return to top page" is selected, the control unit 310 displays, for example, a factory selection screen (see FIG. 11) or a layout screen (see FIG. 14).

Returning to FIG. 6, a case where the “equipment information list” is selected after the function menu button L is clicked by the user will be described. In FIG. 6, the operation of selecting the “equipment information list” by the user is referred to as the “equipment information list request operation”.

When the control unit 310 receives the equipment information list request operation (step S307), the control unit 310 transmits the equipment information list request to the management server 1. The equipment information list request includes information indicating the factory 4 selected by the user (for example, "building A" of "factory J1").

In response to receiving the equipment information list request, the distribution information determination unit 127 reads the equipment information of the factory 4 from the various device information 25 to generate the equipment information list data, and the transmission source of the equipment information list request. Distribute to the information processing device 30 (step S104).

The control unit 310 displays the equipment information list together with the layout diagram and the 3D image already displayed based on the equipment information list data distributed from the management server 1 (step S308: related information display step).

In this way, when the management system 100 is applied, information about various devices 41 installed in the factory 4 to be managed is displayed on the display unit 313 of the information processing device 30 together with the layout diagram and the 3D image of the factory 4. Is displayed. As a result, the user can refer to the factory 4 to be managed and the information necessary for managing the various devices 41 installed in the factory 4 at once. Therefore, the user can efficiently manage the designated factory 4 and various devices 41 of the factory 4.

<Function button group K>
Next, each function shown in the function button group K will be described with reference to FIGS. 7 to 9 with reference to the screen display examples shown in FIGS. 21 to 23.

<Camera selection function button K1>
The camera selection function button K1 is a button for allowing the user to select the camera 40. When the camera selection function button K1 is clicked by the user, the control unit 310 displays information indicating the position where the camera 40 is installed in addition to the layout diagram based on the layout data distributed from the management server 1. ..

FIG. 7 is a diagram showing an example of a processing flow related to the use of the captured image. Note that FIG. 7 is shown as a process following step S306 and step S103 of FIG.

When the control unit 310 accepts the camera selection operation by the user (step S309), the control unit 310 transmits a captured image data request to the management server 1. The captured image data request includes information indicating the camera 40 selected by the user. The information indicating the camera 40 selected by the user includes, for example, information on the installed position, identification information given to each of the cameras 40, and the like, but is not limited thereto.

In response to receiving the captured image data request, the distribution information determination unit 127 reads the captured image data captured in advance from the selected camera 40 from the captured image data 21, and processes the information processing of the transmission source of the captured image request. Deliver to device 30 (step S105).

The control unit 310 displays the image captured by the camera 40 selected by the user based on the captured image data distributed from the management server 1 together with the layout diagram and the 3D image already displayed (step S310). ..

[Camera selection screen]
FIG. 21 is a diagram showing an example of a 3D-2D display screen in which an captured image captured by a camera 40 selected by a user is displayed together with a layout diagram and a 3D image.

As shown in FIG. 17, the position where each of the cameras 40 is installed is displayed in the layout diagram in response to the click of the camera selection function button K1 by the user. In the following, it is assumed that the identification information CP1 to CP12 are given to each of the cameras 40, and the camera 40 to which the identification information CP10 is given is described as "camera CP10" or the like.

When the camera CP10 is selected by the user, as shown in FIG. 17, the image captured in advance from the camera CP10 is displayed in the display area W together with the layout diagram and the 3D image.

The "Live" button F1 is displayed in the display area W. When the user clicks the "Live" button F12, a moving image (second image) of the current factory J1 building A captured by the camera CP10 is displayed in the display area W.

FIG. 8 is a diagram showing an example of a processing flow related to the use of moving images. Note that FIG. 8 is shown as a process following step S310 and step S105 of FIG. Further, in FIG. 8, an operation in which the user clicks the "Live" button F1 is described as a "live video request operation".

When the control unit 310 receives the live video request operation by the user (step S311), the control unit 310 transmits the live video request to the management server 1. The live video request includes information indicating the camera 40 selected by the user and information about the time. The information indicating the camera 40 selected by the user includes, for example, information on the installed position, identification information given to each of the cameras 40, and the like, but is not limited thereto.

The imaging instruction unit 126 transmits an imaging start instruction to the camera CP10 in response to receiving the live video request (step S106).

The camera CP10 starts imaging and starts transmitting the captured moving image data to the management server 1 in response to receiving the imaging start instruction from the management server 1 (step S401).

The distribution information determination unit 127 receives the moving image data from the camera CP10 and starts distribution to the information processing device 30 which is the transmission source of the live video request (step S107).

The control unit 310 causes the display unit 313 to display the live image together with the layout diagram and the 3D image based on the received moving image data (step S312: related information display step).

The distribution information determination unit 127 adds information (for example, a user name, a user ID, etc.) indicating a user who is currently a distribution destination of the live video to the layout data and distributes it (step S108).

The control unit 310 that receives the layout data from the management server 1 to which the information indicating the user who is currently the delivery destination of the live video is added updates the display of the layout diagram (step S313).

[Live video display]
FIG. 22 is a diagram showing an example of a 3D-2D display screen in which a moving image captured by a camera CP10 selected by a user is displayed together with a layout diagram and a 3D image.

In response to the user clicking the "Live" button F1 shown in FIG. 21, the live image V is displayed in the display area W as shown in FIG.

In the layout diagram, information (for example, a user name and a user ID) indicating each user logged in to the management system 100 is additionally displayed from the information processing device 30 which is currently the distribution destination of the live video. For example, in the example shown in FIG. 22, it is shown that a user whose user ID is "xxxxxx" and another user whose user ID is "yyyyyy" are using the moving image data. It is confirmed that the user whose user ID is "xxxxxx" is using the video data from the camera CP10, and another user whose user ID is "yyyyyy" is using the video data from the camera CP1. it can.

By displaying information indicating each user logged in to the management system 100 from the information processing device 30 that is currently the distribution destination of the live video, the usage status of the video data can be confirmed and managed. Is possible.

The "REC" button F2 is displayed in the display area W. The "REC" button F2 is a button for receiving a save (recording) instruction of moving image data from the user. When the user clicks the "REC" button F2, the saving of the moving image data transmitted from the camera CP10 is started. The saved moving image data is saved in the storage unit 2 (for example, captured image data 21) of the management server 1. In FIG. 8, the operation of the user clicking the "REC" button F2 is referred to as a "recording request operation".

Returning to FIG. 8, when the control unit 310 receives the recording request operation (step S314), the control unit 310 transmits the recording request to the management server 1.

The imaging instruction unit 126 starts saving (recording) the moving image data received from the camera CP10 in response to receiving the recording request (step S109).

When the distribution time of the moving image data reaches a predetermined time (for example, 10 minutes), the imaging instruction unit 126 transmits an imaging stop instruction to the camera CP10 (step S110). Further, the distribution information determination unit 127 stops the distribution of the moving image data (step S111). This makes it possible to easily limit the time during which the live video is used by the user.

The camera CP10 stops imaging in response to receiving an imaging stop instruction from the management server 1 (step S402).

The distribution information determination unit 127 saves the moving image data from the camera CP10 in response to the recording request received from the information processing device 30 (step S112: recording step). For example, the saved moving image data is saved in the captured image data 21 together with information such as the captured location, the camera, and the date and time. The user can use the recorded video as a material for managing the work status in the designated facility thereafter.

<Equipment guide button K2>
The equipment guide button K2 is a button for displaying information such as the names of various devices 41 on the layout diagram and the 3D image. When the equipment guide button K2 is clicked by the user, the control unit 310 displays the equipment guide information including the name of each device in addition to the layout diagram based on the layout data distributed from the management server 1.

FIG. 9 is a diagram showing an example of a processing flow related to the use of equipment guide information. Note that FIG. 9 is shown as a process following step S306 and step S103 of FIG. Further, in FIG. 9, an operation in which the user clicks the equipment guide button K2 is described as an “equipment guide request operation”.

When the control unit 310 receives the equipment guide request operation by the user (step S315), the control unit 310 transmits the equipment guide request to the management server 1. The equipment guide request includes information indicating building A of factory J1 selected by the user.

The distribution information determination unit 127 reads out information about various devices 41 installed in the A building of the factory J1 from the various device information 25 in response to receiving the equipment guide request. Further, the distribution information determination unit 127 adds information about various devices 41 installed in the A building of the factory J1 read from the various device information 25 to the layout data and 3D image data of the A building of the factory J1. Deliver (step S113).

The control unit 310 displays equipment guide information regarding various devices 41 installed in the A building of the factory J1 on the layout diagram and the 3D image based on the layout data and the 3D image data distributed from the management server 1 ( Step S316: Related information display step).

[Equipment guide display screen]
FIG. 23 is a diagram showing an example of a 3D-2D display screen in which equipment guide information is displayed in a layout diagram and a 3D image. In the example shown in FIG. 23, the device name of each device is displayed at a position corresponding to the various devices 41 in the layout diagram and the 3D image.

By displaying the equipment guide information on the layout diagram and the 3D image, the user can easily grasp the various devices 41 installed in the factory 4 to be managed. Therefore, the user can efficiently manage the facility to be managed and the various devices 41 of the factory 4.

[Embodiment 2]
(Modified example of the configuration of management server 1)
In the above-described embodiment, the management server 1 may not generate the 3D image data 24 for which the processing of the spherical image captured by the 3D camera and the association with the three-dimensional coordinates have been completed.

For example, you may ask a trader who creates the 3D image data 24 to purchase the 3D image data 24. In this case, since the captured image correction unit 122 and the 3D image synchronization processing unit 123 are unnecessary, the captured image correction unit 122 and the 3D image synchronization processing unit 123 are not essential configurations of the management server 1.

[Embodiment 3]
In the above-described embodiment, the case where various data and image data are distributed from one management server 1 to the information processing device 30 has been described as an example, but a plurality of computers in which the management system 100 has the same functions as the management server 1. May be provided.

For example, when the number of information processing devices 30 as distribution destinations is large, the distribution processing of the management server 1 may be delayed. Alternatively, there is a problem that the management system 100 cannot be used when the management server 1 is repaired, maintained, or updated. By providing the management system 100 with a plurality of computers having the same functions as the management server 1, the user can continue to use the management system 100 even during the period when one management server 1 is stopped. ..

[Example of realization by software]
The control block of the management server 1 (particularly the management control unit 12) and the control block of the information processing device 30 (particularly the control unit 310) are realized by logic circuits (hardware) formed in an integrated circuit (IC chip) or the like. It may be realized by software.

In the latter case, the management server 1 and the information processing device 30 include a computer that executes instructions of a program that is software that realizes each function. The computer includes, for example, one or more processors and a computer-readable recording medium that stores the program. Then, in the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a "non-temporary tangible medium", for example, a ROM (Read Only Memory) or the like, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the above program may be further provided. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

1 Management server (management device)
7 Communication network (communication line)
11 Communication unit 12 Management control unit 30, 30a, 30b Information processing equipment 40, 40a, 40b Camera 41, 41a, 41b Various equipment (equipment)
100 Management system 310 Control unit 313 Display unit S304 Arrangement information display process S306 First image display process S308, S312, S316 Related information display process S112 Recording process

Claims (13)

Arrangement to display the arrangement information indicating the shape of the facility and the arrangement of the equipment installed in the facility on the display unit of the information processing device used by the user in response to the designation of the predetermined facility by the user. Information display process and
In response to the position desired by the user being designated based on the arrangement information, a first image showing the facility as seen from an actual location corresponding to the position is displayed on the display unit together with the arrangement information. The first image display process and
In response to an instruction from the user, related information including at least one of information related to the equipment and information related to the work status in the facility is displayed on the display unit together with the arrangement information and the first image. Including related information display process
A management method characterized by that. In the related information display process,
As information related to the facility, at least one of information on each name, model number, purchase date, operating years, inspection and repair history, purchase price, and the like of the equipment is displayed on the display unit. ,
The management method according to claim 1, wherein the method is characterized by the above. The arrangement information includes information indicating the arrangement of one or more cameras installed in the facility.
In response to the designation of one camera by the user, a second image immediately captured by the camera of the facility is displayed on the display unit.
The management method according to claim 1 or 2, wherein the method is characterized by the above. Information indicating the camera capturing the second image and information about the user using the second image are displayed on the display unit.
The management method according to claim 3, wherein the method is characterized by the above. A recording step of storing the second image is further included in response to a request from the user.
The management method according to claim 3 or 4. The first image is generated by associating an captured image obtained by capturing at least a part of the area of the facility with three-dimensional point cloud data representing the three-dimensional coordinates acquired for the target area including the area. It is a three-dimensional image,
The management method according to any one of claims 1 to 5, characterized in that. In the related information display process,
Depending on the arrangement information or two different positions in the first image specified by the user, the distance between the actual locations corresponding to each of the two positions is displayed on the display unit.
The management method according to any one of claims 1 to 6, characterized in that. In the related information display process,
In response to the arrangement information or one plane in the first image being designated by the user, a cross-sectional view with the plane as a cut surface is displayed on the display unit.
The management method according to any one of claims 1 to 7, wherein the management method is characterized by the above. It has a communication unit and a management control unit.
The communication unit transmits / receives data to / from an information processing device used by the user.
The management control unit
In response to receiving information indicating the facility designated by the user from the information processing device, distribution information indicating the shape of the facility and the arrangement of the equipment installed in the facility is distributed to the information processing device. And
Indicates the facility as viewed from an actual location corresponding to the position in response to receiving information indicating a position desired by the user, which is designated by the user based on the arrangement information, from the information processing apparatus. The first image is delivered to the information processing device,
In response to receiving the request from the user from the information processing device, the information processing device is provided with related information including at least one of information related to the equipment and information related to the work status in the facility. To deliver,
A management device characterized by that. It has a control unit and a display unit.
The control unit
In response to the designation of a predetermined facility by the user, the display unit displays the layout information indicating the shape of the facility and the layout of the equipment installed in the facility.
In response to the position desired by the user being designated based on the arrangement information, a first image showing the facility as seen from an actual location corresponding to the position is displayed on the display unit together with the arrangement information. Let me
In response to an instruction from the user, related information including at least one of information related to the equipment and information related to the work status in the facility is displayed on the display unit together with the arrangement information and the first image. Let,
An information processing device characterized by this. A management device and an information processing device connected to the management device via a communication line are included.
The information processing device
In response to the designation of a predetermined facility by the user, the layout information indicating the shape of the facility and the layout of the equipment installed in the facility is received from the management device, and is displayed on the display unit of the information processing device. Display,
In response to the location desired by the user being designated based on the placement information, a first image showing the facility as viewed from an actual location corresponding to the position is received from the management device and the placement. Displayed on the display unit together with the information
In response to an instruction from the user, related information including at least one of information related to the equipment and information related to the work status in the facility is received from the management device, and the arrangement information and the first Displayed on the display unit together with the image,
A management system characterized by that. The control program for operating a computer as the management device according to claim 9, wherein the control program for operating the computer as the management control unit. The control program for operating a computer as the information processing device according to claim 10, wherein the computer functions as the control unit.

Images