JP7313941B2 - Information management system and information management method - Google Patents

Description

An embodiment of the present invention relates to an information management system and an information management method.

The management of facility information related to facilities such as plants and buildings requires the management of information including two-dimensional or three-dimensional CAD models, which are electronic data, design documents describing various design specifications, and information on actual construction on site. Furthermore, when operating facilities, it is effective to also manage information related to maintenance such as patrol inspection records or site images. For example, as a system for managing information, there is known a technique of constructing a database of CAD models, a database of design documents, and a database relating to maintenance, and extracting necessary information.

Japanese Patent No. 5999679

However, when each database is large and independent, it is necessary to individually search and extract information in order to refer to related information, and the search work requires labor. Furthermore, confirmation or examination is carried out based on the extracted various information, and it is finally recorded in report materials, etc., but there is a problem that it is difficult to manage the information source described in the report materials or the display part.

The embodiments of the present invention have been made in consideration of such circumstances, and it is an object of the present invention to provide an information management technique that can easily reproduce the display mode of a screen related to information that has been confirmed once.

An information management system according to an embodiment of the present invention includes a target information storage unit that stores target information to be used, a screen output unit that outputs a screen related to the target information, a change reception unit that receives a change operation for changing the display mode of the screen, a reproduction information storage unit that stores reproduction information that can reproduce the display mode of the screen changed based on the change operation in association with a reproduction identifier, and a reproduction identifier output unit that outputs the reproduction identifier.The screen is displayed on a browser of a user terminal connected to a network, and the screen is provided with a function of outputting the reproduction identifier that reproduces the display mode of the screen that is currently being displayed. By executing the function, the reproduction identifier is output in at least one form of a character string indicating the reproduction URL, a two-dimensional code indicating the reproduction URL, or a graphic..

The embodiment of the present invention provides an information management technique that can easily reproduce the display mode of a screen related to information that has been confirmed once.

1 is a system configuration diagram showing an information management system; FIG. 1 is a block diagram showing an information management system; FIG. 4 is a block diagram showing a target information storage unit and a reproduction information storage unit; FIG. The screen figure which shows the main page during display of 1 screen. FIG. 11 is a screen diagram showing the main page while displaying 4 screens; FIG. 10 is a screen diagram showing a main page displaying a reproduction URL; FIG. 4 is a screen diagram showing a 3D viewer displaying a 3D view and an area map; FIG. 4 is a screen diagram showing a 3D viewer displaying a 3D view of one screen; FIG. 4 is a screen diagram showing the 3D viewer displaying two screens of 3D views. Explanatory drawing which shows an inspection history table. Explanatory drawing which shows a work plan table. Explanatory drawing which shows a target object management table. FIG. 4 is an explanatory diagram showing a display history management table; 4 is a flowchart showing information management processing executed by the information management system; 4 is a flowchart showing information management processing executed by the information management system;

Hereinafter, embodiments of an information management system and an information management method will be described in detail with reference to the drawings. Reference numeral 1 in FIG. 1 denotes an information management system of this embodiment.

Plants including nuclear power plants, thermal power plants, chemical plants, factories, etc. are regularly inspected or maintained for stable operation. In such plants, various objects such as buildings, equipment, equipment, structures, etc. are provided. The information management system 1 of this embodiment manages object information necessary for inspection or maintenance of these objects. Furthermore, it is also possible to examine the arrangement of these objects and manage modification histories.

Devices include, for example, valves, motors, switchboards, electrical parts, computers, and the like. Furthermore, structures include, for example, tanks, pipes, supporting members, building frames, through holes provided in the frames, rooms, passages, and sites.

As shown in FIG. 1, an information management system 1 is connected to the Internet 2 . The information management system 1 may be mounted on a cloud server outside the plant, or may be mounted on a server inside the plant.

A user U<b>1 as an administrator who manages plant inspection or maintenance work accesses the information management system 1 using a user terminal 3 connected to the Internet 2 . A worker W who works at a work site accesses the information management system 1 using a site terminal 4 connected to the Internet 2 .

The user terminal 3 handled by the user U is, for example, a predetermined computer such as a desktop PC, a notebook PC, or a tablet PC. The user terminal 3 includes an input device such as a mouse or a keyboard used for inputting predetermined information according to the user's U operation. The input operation of this embodiment includes a click operation using a mouse or a touch operation using a touch panel.

The user terminal 3 also includes a display device such as a display 5 that displays a screen related to target information. The display 5 may be separate from the computer main body, or may be integrated with the computer main body. When accessing the information management system 1 via the user terminal 3 and displaying the target information on the display 5 , the control of the screen of the display 5 is controlled by the information management system 1 .

In this embodiment, the display 5 is exemplified as the display device, but other modes may be used. For example, information may be displayed using a projector. Furthermore, a printer that prints information on a paper medium may be used instead of the display 5 . In other words, the objects controlled by the information management system 1 may include a projector or a printer.

4 A of field terminals which the worker W handles are comprised by smart phone 4A provided with a display, for example. The smartphone 4A is equipped with a camera 6 for recording on-site conditions. Note that the display of the smartphone 4A serves as a display device as well as a touch panel as an input device. The input operation of this embodiment includes a touch operation using a touch panel.

A field terminal 4B of a different type handled by another worker W is composed of a wearable computer 4B (smart glasses) equipped with a transmissive head-mounted display 7 worn by the worker W. FIG. The wearable computer 4B may have a structure separated from the transmissive head-mounted display 7 . This transmissive head-mounted display 7 is also equipped with a camera for recording the situation on site. For example, the camera may be an omnidirectional camera 9 installed on the top of the head of the helmet 8 worn by the worker W and capable of capturing an omnidirectional image (omnidirectional image), which is a 360-degree panoramic image. The omnidirectional camera 9 can take an omnidirectional image, for example, by using a fish-eye lens or the like.

Note that the field terminal 4 may be configured by a tablet PC or a notebook PC. In addition, it is composed of devices having a photographing function, a call function, and a communication function, and may be composed of a plurality of devices having each function.

A user U<b>1 as an administrator accesses the information management system 1 using the user terminal 3 , and causes the display 5 of the user terminal 3 to display a screen regarding object information about objects. For example, when a predetermined area of the plant is to be inspected, a sketch showing that area is displayed on the browser 10 (web browser) of the display 5 (see FIG. 4). Further, when inspecting valves in a predetermined area, design drawings, images, 3D-CAD data, etc. of valves to be inspected are displayed on the display 5 (see FIG. 7).

Then, the user U prepares the work plan 11 and gives it to the worker W. The work plan 11 may be either an electronic file or a paper medium. Based on this work plan 11, the worker W carries out the inspection work. The worker W accesses the information management system 1 using the field terminal 4 and causes the display of the field terminal 4 to display a screen regarding target information about the target object.

Here, when the user U creates the work plan 11, for example, when content such as 3D-CAD data is displayed on the display 5 of the user terminal 3, the user U can arbitrarily change the display mode of the screen such as the viewpoint (angle) or the magnification ratio (scale) using an input device such as a mouse or keyboard.

If the worker W to whom the work plan document 11 is handed can see the display mode of the screen that the user U actually saw as it is, it is easy to understand the content. Therefore, in this embodiment, it is possible to output a character string indicating a reproduction URL as a reproduction identifier, a two-dimensional code indicating the URL, and a registered name, which can reproduce the display mode of the screen (see FIG. 6). In this way, it is possible to easily write the reproduction identifier on a predetermined document such as the report 12 . Here, the reproduction URL is one embodiment of the reproduction identifier. This reproduction identifier may be other link information, and is not limited to a character string or two-dimensional code. Also, it may be possible to output a figure indicating a reproduction URL.

The user U writes the output URL for reproduction in the work plan 11 and gives it to the worker W. By inputting the URL for reproduction into the browser 10 (see FIG. 4), the worker W can see the display mode of the screen actually viewed by the user U as it is. Furthermore, when content such as 3D-CAD data is displayed, the worker W can further change the viewpoint from which the user U was looking.

Furthermore, the user U1, who is the administrator, prepares a report 12 describing the URL for reproduction after the inspection work, and gives it to another user U2. Note that the report 12 may be in the form of either an electronic file or a paper medium. By inputting the URL for reproduction into the browser 10, another user U2 can view the display mode of the screen actually viewed by the user U1 who is the administrator.

In this embodiment, different users U1 and U2 or between the user U1 and the worker W can share the completely same screen display mode, so that they can easily communicate with each other. In this way, different users U1 and U2 can share the target information by sharing the reproduction URL. In the case of books, information can be shared at the same position on the page, and in the case of 3D-CAD data, information can be shared at the same viewpoint or magnification. And it is possible to share the details of the information that should be confirmed with certainty. In addition, by describing the URL for reproduction together with the captured screen display in the report 12 or the like, the information used in the report 12 can be easily accessed.

The reproduction URL may be shared as electronic data link information or as a two-dimensional code. For example, the camera 6 of the field terminal 4A having a two-dimensional code reading function may be used to read the two-dimensional code and read the target information screen.

Conventionally, as a method of saving a screen, there is a method of capturing the screen and saving it as image data. However, in this case, since the individual information being displayed is not saved, it is difficult to grasp which information is which part. On the other hand, in the present embodiment, it is possible to read the extracted information and its details. Further, work efficiency can be improved when a plurality of users U or workers W work together.

In this embodiment, information added by plant or building maintenance operations such as patrols can be stored. In the maintenance work, inspection records are sequentially added through patrol inspections or overhaul inspections performed based on the work plan 11 . The information management system 1 makes it easier for the user U or the worker W to grasp the work plan 11 and the results. Equipment to be inspected can be extracted by the search function, and the work plan 11 including a list of inspection targets can be created. Based on this work plan document 11, the worker W inspects predetermined equipment and records the inspection results.

For example, by selecting a device or an area on the user terminal 3, it is possible to check the inspection record registered for each inspection object, that is, the state of the site. For example, the open/closed state of the valve can be visualized and confirmed by the difference in color. Similarly, on the field terminal 4, it is possible to check the status of the previous inspection record of the object to be inspected.

Also, a work plan 11 is created using the information management system 1 and downloaded to the site terminal 4 used at the site. Then, after the work is completed, the result is uploaded from the site terminal 4. - 特許庁For example, a device or area to be worked on is selected on the screen of the field terminal 4, and detailed information and coordinates of the device or area are listed. In addition, work contents can be entered in this list. The worker W can collectively obtain the information of the documents or drawings necessary for the work. After the work, as a result of the work, the date and time, and the information of the person in charge are added and stored as a work record in the field terminal 4, and by uploading it to the information management system 1, the information after the inspection and the information of the existing data can be linked.

In addition, the field terminal 4 has a position information measurement function. For example, if it is an outdoor site, GPS may be used. Since GPS cannot be used indoors, SLAM (Simultaneous Localization And Mapping) technology that estimates the self-position using information acquired by the camera or sensor of the field terminal 4 may be used. Position estimation by communication with a beacon provided at a predetermined position may also be used. Furthermore, a technique such as PDR (Pedestrian Dead Reckoning), which estimates a movement trajectory from information acquired based on accelerometers or gyros, may be used.

When the work plan 11 is created by the information management system 1 of this embodiment, the position information of the object to be worked may be extracted from design data such as 3D-CAD. Furthermore, by using the field terminal 4 having a position information measuring function, a navigation function to the work place may be provided. Furthermore, the site terminal 4 can manage information acquired at the site, such as check sheets, photographs, and videos used for inspection records, in association with location information.

The photo or video acquired by the field terminal 4 may be 360-degree content (see FIG. 8) such as an all-around image. For example, by adjusting the shooting position, the height at the time of shooting, and the orientation at the time of shooting, it is possible to check the 360-degree content in the same way as 3D-CAD data. Further, when adjusting the photographing position, the height at the time of photographing, and the orientation at the time of photographing, the feature points may be extracted from the acquired image and automatically displayed at positions overlapping with the 3D-CAD.

Next, the display mode of the screen of the browser 10 will be described using the screen diagrams of FIGS. 4 to 9. FIG. Note that these display modes are examples, and other modes may be used. Also, the browser 10 can be displayed on either the user terminal 3 or the field terminal 4 . In the following description, a mode displayed on the display 5 of the user terminal 3 will be exemplified.

A user U operates a user terminal 3 to access the information management system 1 via the Internet 2 . By performing predetermined user authentication, the main page 13 can be displayed on the browser 10 of the display 5 of the user terminal 3 . Note that the information management system 1 may store the target information in association with the user authentication ID that allows the user U to be individually identified. Then, the browser 10 may display only the screen regarding the target information for which authentication is permitted.

As shown in FIG. 4, the browser 10 of the user terminal 3 is provided with an address bar 14 . Further, the main page 13 displayed by the browser 10 is provided with a search keyword input field 15, a search result thumbnail display section 16, a search result list display section 17, a data display section 18, an additional search section 19, and a browser shot button 20.

A predetermined URL can be entered in the address bar 14 . The main page 13 can be displayed by inputting a URL indicating the address of the information management system 1 into the address bar 14 . Also, in the address bar 14, it is possible to input a character string of a reproduction URL as a reproduction identifier. By inputting the URL for reproduction into the address bar 14, the display mode of the screen corresponding to the URL for reproduction is reproduced.

A search keyword can be entered in the search keyword input field 15 . For example, the user U enters a keyword for searching, such as a device name, a drawing name, and the like. Target information corresponding to this search keyword is displayed on the main page 13 . For example, the search result thumbnail display section 16 displays thumbnails of target information indicating search results. A list of search results is displayed in the search result list display section 17 . The user selects target information from either the search result thumbnail display section 16 or the search result list display section 17, whichever is easier to select. The search results may be displayed in either the search result thumbnail display section 16 or the search result list display section 17. FIG.

The data display section 18 displays a screen showing target information selected in the search result thumbnail display section 16 or the search result list display section 17 . In FIG. 4, the data display section 18 of one screen is displayed. The user U can change the display mode of the data display section 18 by operating an input device such as a mouse or keyboard. For example, when a schematic drawing or a design drawing is displayed on the data display section 18, the drawing can be enlarged or reduced. The drawing can also be moved left, right, up and down. In the case of books, the page on which the book is displayed or the display position within the page can be changed.

The additional search section 19 displays a list of detailed information about the target information being displayed on the data display section 18 . Detailed information can be retrieved based on these lists. For example, when the data display unit 18 displays a floor plan of the plant, detailed information about the structures or equipment arranged in each area is extracted, and a list of these is displayed in the additional search unit 19. By selecting predetermined detailed information, target information related to the detailed information is displayed on the data display section 18 .

That is, on the main page 13, detailed information about the target information being displayed in the data display section 18 is extracted, and an additional search section 19 showing a list of the detailed information and the data display section 18 displaying an image relating to the target information are displayed side by side.

As shown in FIG. 5, the data display section 18 having a plurality of screens can be displayed by the user U performing a predetermined input operation. That is, the user U can change the display mode of the data display section 18 . For example, in FIG. 5, the data display section 18 of four screens is displayed. Different target information can be displayed on each data display section 18 .

The browser shot button 20 is a selection input unit for outputting a reproduction URL for reproducing the display mode of all screens currently being displayed. The user U selects the browser shot button 20 with the mouse cursor 21 and clicks it, so that the information management system 1 stores the reproduction information indicating the display mode of the screen at that time.

As shown in FIG. 6, when the user U clicks the browser shot button 20, a character string indicating a reproduction URL as a reproduction identifier or a two-dimensional code corresponding to the character string and a registered name are output. The registered name may be any name registered by the user U, or may be automatically generated. The user U1 who is the administrator can describe the character string, the two-dimensional code, or the registered name indicating the URL for reproduction in the work plan 11 or the report 12. FIG.

A worker W or another user U2 inputs, for example, a character string indicating a URL for reproduction into the address bar 14, thereby reproducing and displaying the display mode of the screen actually viewed by the user U1 who is the administrator. Also, the character string indicating the URL for reproduction may be entered in the search keyword entry field 15 . Also, the registered name may be entered in the address bar 14 or the search keyword input field 15 . Furthermore, the display mode of the screen can also be reproduced by photographing the two-dimensional code indicating the reproduction URL with the smartphone 4A.

As shown in FIG. 7, when displaying 3D-CAD data as object information, the display of the browser 10 is switched to the 3D viewer 22. FIG. In FIG. 7, a 3D view 23, an area map 24, a reproduction identifier input section 25, a name registration reading section 26, and a view shot button 27 are provided. It is also possible to select and display predetermined 3D-CAD data from the search result thumbnail display section 16 or search result list display section 17 .

For example, when the floor plan of the plant is being displayed on the data display unit 18 (see FIG. 4), the additional search unit 19 is used to select detailed information of a predetermined area. Then, the screen is switched to the 3D viewer 22, and the area map 24 of the corresponding area is displayed.

When the user U selects a predetermined viewpoint 28 on the display of the area map 24 , an image of 3D-CAD data is displayed in the 3D view 23 with the viewpoint 28 as the viewpoint position. In this 3D view 23, it is possible to arbitrarily change the display mode of the screen such as the viewpoint (angle) or magnification (scale).

In the reproduction identifier input section 25, a character string indicating a reproduction URL as a reproduction identifier, a two-dimensional code, and a registered name are input. An image of the target information corresponding to the input reproduction identifier is displayed in the 3D view 23 or area map 24 .

The viewpoint name indicating the viewpoint 28 or the registered name of the reproduction URL can be registered in the name registration reading unit 26 . Furthermore, it is possible to read the already registered viewpoint name or the registered name of the reproduction URL.

The view shot button 27 is a selection input unit for outputting a reproduction URL for reproducing the display mode of the screen currently displayed on the 3D view 23 or area map 24 . The user U selects the view shot button 27 with the mouse cursor 21 and clicks it, so that the information management system 1 stores reproduction information indicating the display mode of the screen at that time.

When the user U clicks the view shot button 27, a character string indicating a reproduction URL as a reproduction identifier, a two-dimensional code, and a registered name are output. Note that the registered name corresponding to the 3D view 23 is also called a viewpoint name. Also, when the reproduction identifier corresponding to the 3D view 23 is output, the viewpoint 28 corresponding to this reproduction identifier is added to the area map 24 . The viewpoint name may be any name registered by the user U, or may be automatically generated. The user U1 who is the administrator can describe the character string, the two-dimensional code, or the registered name indicating the URL for reproduction in the work plan 11 or the report 12. FIG.

As shown in FIG. 8, the 3D viewer 22 can display an all-around image (omnidirectional image), which is a 360-degree panoramic image, in addition to the 3D-CAD data. For example, the 3D viewer 22 is provided with a 360-degree content display section 29 . The 360-degree content display section 29 can display an all-around image. The 360-degree content display unit 29 can arbitrarily change the display mode of the screen such as the viewpoint (angle) or magnification (scale).

Note that the worker W can store images acquired during the work in the information management system 1 . For example, an omnidirectional camera 9 (see FIG. 1) on the helmet 8 of the worker W can acquire an omnidirectional image and store it in the information management system 1 . Objects in a range of 360 degrees centering on the helmet 8 of the worker W are shown in the omnidirectional image. Instead of using the helmet 8 of the worker W, the omnidirectional camera 9 may be installed on the site using a tripod for photographing.

As shown in FIG. 9, an image of 3D-CAD data and an all-around image corresponding to the 3D-CAD data can be displayed side by side. When the user U clicks the browser shot button 20, the overall display mode of the browser 10 is stored as reproduction information, and a corresponding reproduction identifier is output. Further, when the user U clicks the view shot button 27, the corresponding screen display mode is stored as reproduction information, and the corresponding reproduction identifier is output.

The worker W who receives the reproduction identifier from the user U can see the display mode of the screen actually viewed by the user U by inputting the reproduction identifier into the browser 10 (see FIG. 4). Furthermore, the worker W can further change the viewpoint that the user U was looking at.

When the worker W wants to show the user U the display mode of the screen viewed using the field terminal 4 as it is, the browser shot button 20 or the view shot button 27 is pressed to output the reproduction identifier. If this reproduction identifier is sent to the user U, the display mode of the screen actually viewed by the worker W can be viewed on the user terminal 3 of the user U as it is.

As shown in FIG. 10 , the information management system 1 can output an inspection history table showing past inspection history in order to create a work plan 11 . When the object to be inspected is a device such as a valve, the inspection history table registers, for example, the contents indicating the closed state or open state of the valve, the result indicating whether the inspection defect is good or bad, and the date and time when the inspection was performed, in association with each item of the inspection history. In addition, if there are points to be noted in past inspections, those items are separately registered.

As shown in FIG. 11, the information management system 1 can output a work plan table in order to create a work plan document 11. FIG. When the object to be inspected is a device such as a valve, in this work plan table, for example, reference information such as coordinates indicating the position information of the valve, the device number of the valve, the device name of the valve, the content of the inspection, the URL of the valve manufacturer, or the URL for reproduction is registered in association with the item indicating the order of the work plan. Furthermore, after the inspection work, information on the inspection result, inspection date and time, inspection person in charge, etc. is registered.

In addition, in this embodiment, although the aspect which uses the information management system 1 for maintenance inspection work is illustrated, another aspect may be sufficient. For example, the information management system 1 may be used when designing the layout of equipment. Furthermore, if it is not necessary to link work plan information or inspection records, for example, in operations such as equipment layout design, specification confirmation, drawing/inspection records, and photo confirmation, the search function or display history function of the information management system 1 may be used.

In the present embodiment, the information management system 1 is used to share the same screen display mode between different users U1 and U2, but the information management system 1 may be used so that the same user U1 can share the same screen display mode. For example, a reproduction identifier indicating the display mode of the screen viewed by the user U1 at a predetermined time is recorded, and three months later, the same user U1 uses the reproduction identifier to reproduce and display the previously displayed display mode. In other words, different users may mean users at different times in addition to meaning different persons.

Next, the system configuration of the information management system 1 will be described with reference to block diagrams shown in FIGS. 2 and 3. FIG.

As shown in FIG. 2 , the information management system 1 includes a main control section 30 , a communication section 31 , a target information storage section 32 and a reproduction information storage section 33 .

Further, the main control unit 30 includes a screen output unit 34, a change reception unit 35, a keyword reception unit 36, a target information extraction unit 37, an additional search reception unit 38, a detailed information extraction unit 39, a work plan creation unit 40, a designation reception unit 41, a reproduction identifier output unit 42, a reproduction identifier reception unit 43, a reproduction information identification unit 44, and a display mode reproduction unit 45. These are implemented by executing programs stored in the memory or HDD by the CPU.

As shown in FIG. 3 , the object information storage unit 32 includes a design information database 46 , an object information database 47 , a site information database 48 and a management database 49 . The reproduction information storage unit 33 has a display history database 50 . These databases 46 to 50 are collections of information stored in memory or HDD and organized so that they can be retrieved or stored.

The information management system 1 of the present embodiment is configured by a computer having hardware resources such as a CPU, ROM, RAM, and HDD, and executing various programs by the CPU to realize information processing by software using the hardware resources. Furthermore, the information management method of this embodiment is implemented by causing a computer to execute a program.

As shown in FIG. 2, the main control unit 30 controls the information management system 1 in an integrated manner. The main control unit 30 also controls the browser 10 (see FIG. 4) displayed on the display 5 of the user terminal 3 connected via the Internet 2. FIG.

The communication unit 31 communicates with electronic equipment such as the user terminal 3 or the field terminal 4 via a communication line such as the Internet 2 . This communication unit 31 may be installed in a wireless communication device. Also, the communication unit 31 may be installed in a predetermined network device such as a wireless LAN access point or an antenna.

The target information storage unit 32 stores data relating to target information to be used in various databases 46-49.

The reproduction information storage unit 33 stores reproduction information capable of reproducing the display mode of the screen changed based on the change operation of the user U in association with the reproduction identifier.

The screen output unit 34 performs control to output a screen related to target information. For example, it controls the display of the screen of the browser 10 displayed on the display 5 of the user terminal 3 . The screen output unit 34 displays the screen of the main page 13 or the 3D viewer 22 on the user terminal 3 .

The change accepting unit 35 accepts a change operation for changing the display mode of the screen. For example, the user U operates an input device such as a mouse or keyboard to accept an operation to change the display mode of the data display section 18 (see FIG. 4) of the browser 10 . Also, when content such as 3D-CAD data is displayed (see FIG. 9), the user U uses an input device such as a mouse or keyboard to accept an operation to arbitrarily change the display mode of the screen such as the viewpoint (angle) or magnification (scale).

The keyword accepting unit 36 accepts input of any keyword. For example, a search keyword input to the search keyword input field 15 (see FIG. 4) of the browser 10 is accepted.

The target information extraction unit 37 extracts target information stored in the target information storage unit 32 in association with the keyword received by the keyword reception unit 36 . Then, the screen output unit 34 performs control to output a screen related to the extracted target information to the display 5 of the user terminal 3 . In this way, the user U can search for target information related to any keyword.

The additional search reception unit 38 receives a search for detailed information on the target information being displayed on the screen of the user terminal 3 . For example, a list of detailed information about the target information being displayed in the data display section 18 is displayed in the additional search section 19 of the browser 10 (see FIG. 4). Then, based on these lists, a search for detailed information is accepted. For example, the user U selects predetermined detailed information from the list of detailed information. This selection accepts a search for detailed information.

The detailed information extraction unit 39 extracts the detailed information received by the additional search reception unit 38 from the target information storage unit 32 . The screen output unit 34 displays a screen regarding detailed information extracted by the detailed information extraction unit 39 . In this way, the user U can obtain further detailed information about the target information being displayed on the screen.

The screen for detailed information may be displayed on the data display section 18 or may be displayed separately from the data display section 18 . Furthermore, a screen showing the target information being displayed on the data display section 18 and a screen showing detailed information related thereto may be displayed side by side.

The work plan creating unit 40 creates the work plan document 11 . For example, if the target information being displayed on the screen of the user terminal 3 is related to an arbitrary area of the work site, a list related to work in the area is output. In this way, a work plan such as inspection work for any area of the work site can be made.

The designation receiving unit 41 receives designation of the display mode of the screen at any time. Designation of the display mode of the screen means that the user U clicks the browser shot button 20 or the view shot button 27 . Here, the reproduction information storage unit 33 stores reproduction information of the display mode of the screen when the designation receiving unit receives the designation. For example, when the user U clicks the browser shot button 20 or the view shot button 27 , reproduction information indicating the display mode of the screen at that time is stored in the reproduction information storage unit 33 . In this way, the user U can designate the display mode of the screen at an arbitrary point of time, and then reproduce the display mode of the screen at an arbitrary point of time.

The reproduction identifier output unit 42 outputs the reproduction identifier stored in the reproduction information storage unit 33 in association with the reproduction information when the designation receiving unit 41 receives the designation of the display mode of the screen at any time. For example, a character string indicating a reproduction URL as a reproduction identifier, a two-dimensional code, and a registered name are output to the screen of the user terminal 3 (see FIG. 6).

The reproduction identifier reception unit 43 receives an input of a reproduction identifier. For example, the worker W who receives the reproduction URL from the user U enters the reproduction URL into the address bar 14 of the browser 10 (see FIG. 4) as a reproduction identifier. The reproduction identifier reception unit 43 receives the inputted reproduction URL.

The reproduction information identifying unit 44 identifies reproduction information stored in the reproduction information storage unit 33 in association with the reproduction identifier received by the reproduction identifier receiving unit 43 .

The display mode reproducing unit 45 reproduces the display mode of the screen based on the reproduction information specified by the reproduction information specifying unit 44 . In this way, the display mode of the screen can be reproduced using the reproduction identifier as a key.

As shown in FIG. 3, the design information database 46 stores target information including at least one of drawings and CAD data relating to plants.

The design information database 46 stores various data such as 3D-CAD data, piping and instrumentation diagram (P&ID) data, outline drawing and structural drawing data, layout drawing data, and the like. The design information database 46 stores data indicating design information of buildings, facilities, and the like provided in the plant. For example, 3D-CAD data includes dimensions of structures. The data of outline drawings and structural drawings include design materials or specifications relating to structures and members constituting structures. Layout map data includes drawings related to layout information.

The object information database 47 stores object information about objects installed in the plant. The object information database 47 stores, for example, various data related to structures such as book data and drawing data.

The site information database 48 stores various data such as scan data, photo and video data, and work record data. This site information database 48 stores target information including at least one of laser scan data, photographs, and moving images added during plant operation. That is, various data acquired by the worker W using the field terminal 4 at the work site are saved. For example, photos or videos taken at the site, laser scan data (for example, point cloud data) acquired after construction or modification are stored. Further, data added by plant operation such as patrol inspection may be stored. In this way, a huge amount of target information added during plant operation can be managed.

As shown in FIG. 3, the management database 49 stores attribute information about attributes of objects. For example, attribute information such as a name or specification related to a structure as an object is saved. This management database 49 has an object management table (see FIG. 12). In this way, it is possible to improve the efficiency of searching for information on plant objects.

As shown in FIG. 12, in the object management table, various data are registered in association with object IDs as object identification information that can individually identify a plurality of objects. That is, the object management table registers object information in association with object IDs. In this way, information about the object can be managed using the object identification information as a key.

For example, 3D position information indicating the 3D position where the object is arranged is registered. An area ID indicating an area in which the object is arranged is registered. A search keyword used to search for an object is registered. An image ID indicating an image of an object captured by a camera is registered. A 3D content ID indicating the 3D-CAD data of the object is registered. A omnidirectional image ID indicating an omnidirectional image in which an object is captured is registered. Terminal position information indicating the three-dimensional position of the on-site terminal 4 when various data related to the target object is acquired is registered.

By inputting information required by the user U as a search keyword into the browser 10 (see FIG. 4), relevant target information is extracted from various databases 46-49. Then, it is displayed on the data screen of the corresponding part in the CAD data or book data. It is also possible to display other related CAD data, the name of the book data, the information of the device in the displayed CAD data, and the like.

Here, by assigning object IDs (Tag No.) to the information stored in the respective databases 46 to 49 and storing them, it becomes possible to efficiently extract related object information at the time of searching.

In this embodiment, target information (for example, an all-around image) can be acquired by the site terminal 4 possessed by the worker W who performs the work. Then, the target information storage unit 32 stores the terminal position information indicating the position of the field terminal 4 when the target information was acquired in association with the target information. In this way, the target information can be searched using the position information as a key. For example, the terminal location information is registered as the viewpoint 28 (see FIG. 7). By designating the view point 28, the image obtained at that position can be displayed.

An omnidirectional image can be acquired as target information by the omnidirectional camera 9 of the field terminal 4B. Moreover, the terminal position information stored in the object management table is three-dimensional position information. That is, the target information storage unit 32 stores the terminal position information including the height of the field terminal 4B when the target information was acquired in association with the target information. In this way, since the height position of the omnidirectional camera 9 when acquiring the omnidirectional image can be grasped, the situation of the actual work site can be grasped from the omnidirectional image.

As shown in FIG. 3, the display history database 50 stores data such as reproduction information. This reproduction information is stored in association with the reproduction identifier. That is, the screen display mode regarding the target information is saved in the display history database 50 . The display history database 50 has a display history management table (see FIG. 13). In this way, it is possible to manage the display mode of the screen regarding information once confirmed.

As shown in FIG. 13, in the display history management table, various data as reproduction information are registered in association with reproduction URLs or registered names as reproduction identifiers. For example, screen information indicating the number or type of screens being displayed in the browser 10 is registered. An image ID that can individually identify an image being displayed on the browser 10 is registered. A 3D content ID that can individually identify the 3D content being displayed on the browser 10 is registered. The display state of the 3D content being displayed on the browser 10, such as the viewpoint (angle) or magnification (scale), is registered. A omnidirectional image ID is registered that allows each omnidirectional image being displayed on the browser 10 to be individually identified. The display state such as the viewpoint (angle) or magnification (scale) of the omnidirectional image being displayed in the browser 10 is registered. That is, the reproduction information of the present embodiment includes screen information, image ID, 3D content ID, its display state, omnidirectional image ID, and its display state. Note that other data may be included in the reproduction information .

As shown in FIG. 3, in this embodiment, reproduction information is stored in a display history database 50. FIG. In this way, it is possible for a predetermined user U1 to save the screen display mode of the target information retrieved from the various databases 46 to 49 with respect to the information for which the examination results are to be written in the report 12 . Therefore, another user U2 can easily reproduce the target information and the display at the time of examination.

Also, the reproduction identifier associated with each piece of reproduction information is stored in the display history database 50 . By sharing the reproduction identifier with different users U2 or workers W, it is possible to share the result of examination. Furthermore, in addition to CAD models and design documents for each piece of equipment, construction status information, patrol inspection records, site images, etc. can be managed by linking them with object IDs as object identification information, and related information searches can be made more efficient.

Furthermore, when the user U selects the target information displayed on the data display unit 18, for example, a device such as a valve on the displayed drawing, detailed information on the selected portion can be additionally retrieved. Then, detailed information can be extracted from the databases 46-49 and displayed. As a result, the associated information can be retrieved collectively, thereby shortening the retrieval time and improving the work efficiency.

Next, information management processing executed by the information management system 1 will be described with reference to flowcharts of FIGS. 14 and 15. FIG. Incidentally, FIG. 1 to FIG. 13 described above will be referred to as needed.

This process is a process that is repeated at regular time intervals. By repeating this process, the information management method is executed in the information management system 1 . Note that this processing may be interrupted while the information management system 1 is executing other main processing.

In the following example, a mode in which the information management system 1 communicates with the user terminal 3 is exemplified.

As shown in FIG. 14 , first, in step S<b>11 , the main control unit 30 of the information management system 1 determines whether or not target information is input from the field terminal 4 . That is, the operator W determines whether or not there is additional input of various data acquired using the field terminal 4 at the work site. Here, if there is no target information input (NO in step S11), the process proceeds to step S13. On the other hand, if there is an input of target information (YES in step S11), the process proceeds to step S12.

In step S<b>12 , the target information storage unit 32 stores the target information input from the site terminal 4 in the site information database 48 . Note that the target information may be stored in other databases 46, 47, and 49. FIG.

In step S<b>13 , the keyword reception unit 36 determines whether or not a search keyword input to the search keyword input field 15 (see FIG. 4 ) of the browser 10 has been received. Here, if no search keyword is received (NO in step S13), the process proceeds to step S16. On the other hand, if the search keyword is accepted (YES in step S13), the process proceeds to step S14.

In step S<b>14 , the target information extraction unit 37 extracts the target information stored in the target information storage unit 32 in association with the keyword received by the keyword reception unit 36 .

In the next step S<b>15 , the screen output unit 34 performs control to output a screen regarding the target information extracted by the target information extraction unit 37 . For example, the browser 10 displayed on the display 5 of the user terminal 3 is caused to display a screen regarding the target information.

In step S<b>16 , the additional search reception unit 38 determines whether or not a search for detailed information on the target information being displayed on the screen of the user terminal 3 has been received. Here, if the search for detailed information has not been received (NO in step S16), the process proceeds to step S19. On the other hand, if the search for detailed information has been received (YES in step S16), the process proceeds to step S17.

In step S17, the detailed information extraction unit 39 extracts the detailed information received by the additional search reception unit 38 from various databases 46 to 49 of the target information storage unit 32. FIG.

In the next step S18, the screen output unit 34 performs control to output a screen regarding the detailed information extracted by the detailed information extraction unit 39. FIG. For example, the browser 10 displayed on the display 5 of the user terminal 3 is caused to display a screen regarding detailed information.

In step S<b>19 , the work plan creating unit 40 determines whether or not an operation to display a work plan chart including a list of inspection objects has been received. Here, if the display of the work plan table has not been received (NO in step S19), the process proceeds to step S22. On the other hand, if the display of the work plan table has been received (YES in step S19), the process proceeds to step S20.

In step S 20 , the work plan creation unit 40 creates a work plan table based on the target information stored in the various databases 46 to 49 of the target information storage unit 32 .

In the next step S21, the work plan creation unit 40 performs control to output a screen regarding the created work plan table. For example, the browser 10 displayed on the display 5 of the user terminal 3 is caused to display a screen regarding the work plan table. Note that the work plan 11 in which the work plan is described may be output by printing.

In step S<b>22 , for example, the change receiving unit 35 determines whether or not the user terminal 3 has received a change operation to change the display mode of the screen. Here, if an operation to change the display mode of the screen has not been accepted (NO in step S22), the process proceeds to step S24. On the other hand, if an operation to change the display mode of the screen has been received (YES in step S24), the process proceeds to step S23.

In step S<b>23 , the screen output unit 34 performs control to change the display mode of the screen based on the change operation received by the change receiving unit 35 . For example, the user terminal 3 changes the display mode of the screen.

In step S24, the designation receiving unit 41 determines whether or not the output of the reproduction identifier has been received. For example, it is determined whether or not the browser shot button 20 or the view shot button 27 has been clicked on the user terminal 3 (see FIG. 5). Here, if the output of the reproduction identifier has not been received (NO in step S24), the process proceeds to step S27. On the other hand, if the output of the reproduction identifier has been received (YES in step S24), the process proceeds to step S25.

In step S25, the reproduction information storage unit 33 stores reproduction information capable of reproducing the display mode of the screen of the user terminal 3 at the time when the designation receiving unit 41 receives the output of the reproduction identifier, in association with the reproduction identifier.

In the next step S26, the reproduction identifier output unit 42 outputs the reproduction identifier stored in the reproduction information storage unit 33 in association with the reproduction information to the screen of the user terminal 3 (see FIG. 6).

In step S27, the reproduction-identifier accepting unit 43 determines whether or not an input of a reproduction identifier has been accepted. For example, the user terminal 3 determines whether or not a reproduction URL has been input to the address bar 14 (see FIG. 4) or the reproduction identifier input section 25 (see FIG. 7) of the browser 10 . Here, if the input of the reproduction identifier has not been received (NO in step S27), the process is terminated. On the other hand, if the input of the reproduction identifier has been received (YES in step S27), the process proceeds to step S28.

In step S<b>28 , the reproduction information identifying unit 44 identifies reproduction information stored in the reproduction information storage unit 33 in association with the reproduction identifier received by the reproduction identifier receiving unit 43 .

In the next step S<b>29 , the display mode reproducing unit 45 reproduces the display mode of the screen based on the reproduction information specified by the reproduction information specifying unit 44 . For example, the screen output unit 34 controls the display mode of the browser 10 displayed on the display 5 of the user terminal 3 based on the display mode reproduced by the display mode reproduction unit 45 . Then, the process ends.

In the flowchart of the present embodiment, each step is executed in series, but the order of steps is not necessarily fixed, and the order of some steps may be changed. Also, some steps may be executed in parallel with other steps.

The system of this embodiment is a highly integrated processor of dedicated chips, FPGA (Field Programmable Gate Array), GPU (Graphics Processing Unit), or CPU (Central Processing Unit). Display control devices, storage devices such as ROM (Read Only Memory), RAM (Random Access Memory), external storage devices such as HDD (Hard Disk Drive) or SSD (Solid State Drive), and displays. Equipped with a device, an input device such as a mouse or keyboard, and a communication interface. This system can be realized with a hardware configuration using a normal computer.

It should be noted that the program executed by the system of the present embodiment is pre-installed in a ROM or the like and provided. Alternatively, this program may be stored in a non-transitory computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD, flexible disk (FD) as an installable or executable file and provided.

Also, the program executed by this system may be stored on a computer connected to a network such as the Internet, downloaded via the network, and provided. In addition, this system can also be configured by combining separate modules that independently perform each function of the constituent elements and are interconnected by a network or a dedicated line.

In this embodiment, the information management system 1, the user terminal 3, and the field terminal 4 are connected to each other via the Internet 2, but other aspects may be adopted. For example, they may be connected to each other via a LAN (Local Area Network), a WAN (Wide Area Network), or a mobile communication network.

When the user U1 communicates with another user U2 or worker W verbally, such as by telephone, the registered name of the reproduction URL may be verbally communicated to the other user U2 or worker W.

In the present embodiment, the user U1 who is the administrator passes the URL for reproduction to the other user U2 so that the display mode of the screen can be reproduced, but other modes may be used. For example, the same user U1 may later reproduce the display mode of the screen using the reproduction URL.

In the present embodiment, the target information managed by the information management system 1 is information related to inspection or maintenance of the plant, but other modes may be used. For example, the information management system 1 may manage information on objects related to a virtual plant or a plant under planning, in addition to the actual plant. Furthermore, the information management system 1 may manage information on objects related to facilities other than the plant.

According to the embodiment described above, by providing the reproduction information storage unit that stores the reproduction information capable of reproducing the display mode of the screen changed based on the change operation in association with the reproduction identifier, it is possible to easily reproduce the display mode of the screen related to the once-confirmed information.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations can be made without departing from the scope of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, as well as the scope of the invention described in the claims and equivalents thereof.

1... Information management system, 2... Internet, 3... User terminal, 4 (4A, 4B)... On-site terminal, 5... Display, 6... Camera, 7... Transparent head mounted display, 8... Helmet, 9... Omnidirectional camera, 10... Browser, 11... Work plan, 12... Report, 13... Main page, 14... Address bar, 15... Search keyword input field, 16... Search result thumbnail display part, 17... Search result list display part, 18... Data display part, 19... Addition Search unit 20 Browser shot button 21 Mouse cursor 22 3D viewer 23 3D view 24 Area map 25 Reproduction identifier input unit 26 Name registration reading unit 27 View shot button 28 Viewpoint 29 360-degree content display unit 30 Main control unit 31 Communication unit 32 Target information storage unit 33 Reproduction information storage unit 34 Screen output unit 35 Change reception unit 36 Keyword reception part 37 Target information extraction part 38 Additional search reception part 39 Detailed information extraction part 40 Work plan creation part 41 Designation reception part 42 Reproduction identifier output part 43 Reproduction identifier reception part 44 Reproduction information specification part 45 Display mode reproduction part 46 Design information database 47 Object information database 48 Site information database 49 Management database 50 Display history database U (U1, U2) User W … workers.

Claims (12)

a target information storage unit for storing target information to be used;
a screen output unit that outputs a screen related to the target information;
a change reception unit that receives a change operation for changing the display mode of the screen;
a reproduction information storage unit that stores reproduction information capable of reproducing the display mode of the screen changed based on the change operation in association with a reproduction identifier;
a reproduction identifier output unit that outputs the reproduction identifier;
with
The screen is displayed on a browser of a user terminal connected to the network,
The screen is provided with a function of outputting the reproduction identifier that reproduces the display mode of the screen that is currently being displayed,
By executing the function, the reproduction identifier is output in the form of at least one of a character string indicating the reproduction URL, a two-dimensional code indicating the reproduction URL, and a graphic.
Information management system. a reproduction identifier reception unit that receives an input of the reproduction identifier;
a reproduction information identifying unit that identifies the reproduction information associated with the received reproduction identifier;
a display mode reproduction unit that reproduces the display mode of the screen based on the identified reproduction information;
comprising a
The information management system according to claim 1. A designation reception unit that receives designation of the display mode of the screen at any time,
The reproduction information storage unit stores the reproduction information of the display mode of the screen at the time of receiving the designation.
The information management system according to claim 1 or 2. a keyword reception unit that receives an input of an arbitrary keyword;
a target information extraction unit for extracting the target information stored in the target information storage unit in association with the received keyword;
with
wherein the screen output unit outputs the screen related to the extracted target information;
The information management system according to any one of claims 1 to 3. an additional search reception unit that receives a search for detailed information about the target information being displayed on the screen;
a detailed information extraction unit that extracts the received detailed information from the target information storage unit;
with
The screen output unit displays the screen related to the extracted detailed information;
The information management system according to any one of claims 1 to 4. The target information being displayed on the screen is related to an arbitrary area of the work site, and a work plan creation unit that outputs a list related to work in the area.
The information management system according to any one of claims 1 to 5. The target information can be acquired by a terminal possessed by the worker who performs the work,
The target information storage unit stores position information indicating the position of the terminal when the target information was acquired in association with the target information,
The information management system according to any one of claims 1 to 6. The target information is an all-surrounding image acquired by the terminal,
The target information storage unit stores the position information including the height of the terminal when the target information was acquired in association with the target information.
The information management system according to claim 7. The target information storage unit is
a design information database in which the target information including at least one of drawings and CAD data relating to the plant is stored;
an object information database in which the object information related to objects provided in the plant is stored;
a management database in which attribute information relating to attributes of the object is stored;
comprising a
The information management system according to any one of claims 1 to 8. The target information storage unit stores the target information in association with target object identification information that can individually identify a plurality of the target objects.
The information management system according to claim 9. The target information storage unit is
A site information database in which the target information including at least one of laser scan data, photos, and videos added during operation of the plant is stored,
The information management system according to claim 9 or 10. the computer
a step of storing target information to be used;
a step of outputting a screen regarding the target information;
receiving a change operation for changing the display mode of the screen;
a step of storing reproduction information capable of reproducing the display mode of the screen changed based on the change operation in association with a reproduction identifier;
outputting the reproduction identifier;
is a way to run
The screen is displayed on a browser of a user terminal connected to the network,
The screen is provided with a function of outputting the reproduction identifier that reproduces the display mode of the screen that is currently being displayed,
By executing the function, the reproduction identifier is output in at least one form of a character string indicating the reproduction URL, a two-dimensional code indicating the reproduction URL, or a graphic.
Information management method.

Images