JP6736898B2 - Facility inspection support program, facility inspection support method, and information processing device - Google Patents

Description

The present invention relates to a facility inspection support program, a facility inspection support method, and an information processing device.

In recent years, an AR content called augmented reality (hereinafter referred to as AR (Augmented Reality)) in which content is displayed on an imaging screen by imaging a marker installed on an article using a tablet terminal or the like having a built-in camera. Is displayed. Further, it has been proposed to attach an AR marker to the equipment in the factory to manage the equipment in the factory.

JP, 2014-175709, A JP, 2014-010800, A

When manufacturing one product, there are cases where a plurality of equipments are arranged side by side on a manufacturing line in a factory, and each equipment sequentially carries out a predetermined manufacturing process. In such a production line, when one of the plurality of equipments outputs an abnormal state, the equipment that outputs the abnormal state is confirmed in order to recover the abnormal state.

However, there is no abnormality in the equipment itself that has output the abnormal state, and the execution of the manufacturing process by other equipment in the production line may cause the output of the abnormal state. In this case, the items to be confirmed for other equipment depend on the experience of the factory manager, and it is difficult to easily find the cause of the abnormal state.

In one aspect, the present invention is to provide an equipment inspection support program, an equipment inspection support method, and an information processing apparatus capable of displaying information necessary for equipment inspection.

In one aspect, the facility inspection support program causes the computer to execute a process of providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference item. Further, the facility inspection support program causes the computer to execute a process of switching the AR content to be provided depending on whether an abnormality is detected in the facility or not.

Information required for facility inspection can be displayed.

FIG. 1 is a block diagram showing an example of the configuration of the inspection support system of the embodiment. FIG. 2 is a diagram illustrating an example of the inspection calendar storage unit. FIG. 3 is a diagram illustrating an example of the inspection item storage unit. FIG. 4 is a diagram illustrating an example of the AR content storage unit. FIG. 5 is a diagram illustrating an example of the abnormality information storage unit. FIG. 6 is a diagram showing an example of the inspection screen. FIG. 7 is a diagram showing another example of the inspection screen. FIG. 8 is a diagram showing another example of the inspection screen. FIG. 9 is a diagram showing an example of the list screen. FIG. 10 is a flowchart showing an example of the first support process of the embodiment. FIG. 11 is a flowchart showing an example of the second support process of the embodiment. FIG. 12 is a diagram illustrating an example of a computer that executes the facility inspection support program.

Hereinafter, embodiments of a facility inspection support program, a facility inspection support method, and an information processing apparatus disclosed in the present application will be described in detail with reference to the drawings. The disclosed technology is not limited to the present embodiment. Further, the following embodiments may be combined as appropriate within a range that does not contradict.

FIG. 1 is a block diagram showing an example of the configuration of the inspection support system of the embodiment. The inspection support system 1 illustrated in FIG. 1 includes a terminal device 10 and an information processing device 100. In addition, in FIG. 1, the number of the terminal devices 10 is shown as one example, but the number of the terminal devices 10 is not limited, and the terminal devices 10 may have an arbitrary number. In the following embodiments, the case where the facility to be inspected is a projector will be described as an example.

The terminal device 10 and the information processing device 100 are connected via a network N so that they can communicate with each other. As the network N, any type of communication network such as LAN (Local Area Network) and VPN (Virtual Private Network) can be adopted, including the Internet, regardless of wired or wireless.

The terminal device 10 is, for example, a computer used by a maintenance person who inspects equipment. The terminal device 10, for example, reads an AR marker attached to the facility by an operation of a maintenance person, and transmits identification information of the AR marker to the information processing device 100. The terminal device 10 receives and displays the AR content corresponding to the identification information transmitted from the information processing device 100. As an example of the terminal device 10, a tablet terminal can be adopted. In addition to the above-mentioned tablet terminal, for example, a portable personal computer, a mobile communication terminal such as a smartphone or a mobile phone, or the like can be adopted as the portable terminal of the terminal device 10.

The information processing apparatus 100 is a computer that transmits AR content corresponding to the received identification information to the terminal apparatus 10 and provides the AR content according to the identification information received from the terminal apparatus 10. That is, the information processing apparatus 100 provides AR content corresponding to the received identification information in response to the reception of the identification information of the reference object such as the AR marker. In addition, the information processing apparatus 100 switches the AR content to be provided depending on whether an abnormality is detected in the facility or not. Thereby, the information processing apparatus 100 can display the information necessary for facility inspection.

Next, the configuration of the terminal device 10 will be described. As shown in FIG. 1, the terminal device 10 includes a communication unit 11, an input unit 12, a display operation unit 13, a storage unit 14, and a control unit 15. Note that the terminal device 10 may include various functional units of a known computer other than the functional units illustrated in FIG. 1, for example, various functional units such as various input devices and audio output devices.

The communication unit 11 is realized by, for example, a communication module such as a wireless LAN. The communication unit 11 is a communication interface that is wirelessly connected to the information processing apparatus 100 via the network N and controls information communication with the information processing apparatus 100. The communication unit 11 transmits the identification information, the operation information, and the like input from the control unit 15 to the information processing device 100. The communication unit 11 also receives AR content, various screens, and the like from the information processing device 100. The communication unit 11 outputs the received AR content and various screens to the control unit 15.

The input unit 12 is, for example, an input device that receives input of identification information of an AR marker attached to a projector that is equipment. For example, the input unit 12 is realized by a camera that images an AR marker. The input unit 12 captures an image by using, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor as an imaging element. The input unit 12 photoelectrically converts the light received by the image pickup device and performs A/D (Analog/Digital) conversion to generate a picked-up image. The input unit 12 outputs the generated captured image to the control unit 15.

The display operation unit 13 is a display device for displaying various types of information and an input device that receives various types of operations from a user, that is, a maintenance person. For example, the display operation unit 13 is realized by a liquid crystal display or the like as a display device. Further, for example, the display operation unit 13 is realized by a touch panel or the like as an input device. That is, in the display operation unit 13, the display device and the input device are integrated. The display operation unit 13 outputs the operation input by the maintenance person to the control unit 15 as operation information.

The storage unit 14 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. The storage unit 14 stores the AR content and various screens received from the information processing apparatus 100. The storage unit 14 also stores information used for the processing by the control unit 15.

The control unit 15 is realized by, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing a program stored in an internal storage device using a RAM as a work area. The control unit 15 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

When the captured image is input from the input unit 12, the control unit 15 detects the AR marker from the captured image. The control unit 15 acquires identification information (hereinafter, also referred to as an identification ID) from the detected AR marker. The control unit 15 transmits the acquired identification information to the information processing device 100 via the communication unit 11 and the network N. The control unit 15 also receives AR content, various screens, and the like from the information processing apparatus 100 via the network N and the communication unit 11. The control unit 15 outputs the received AR content and various screens to the display operation unit 13 for display. For example, when the control unit 15 receives the inspection screen from the information processing device 100, the control unit 15 causes the display operation unit 13 to display the received inspection screen. At this time, the control unit 15 also displays the captured image input from the input unit 12 in the inspection screen, for example. The control unit 15 also stores the received AR content and various screens in the storage unit 14. Further, operation information is input to the control unit 15 from the display operation unit 13. For example, when the operation information to start the inspection is input, the control unit 15 transmits the operation information to start the inspection to the information processing apparatus 100 via the communication unit 11 and the network N.

Next, the configuration of the information processing device 100 will be described. As illustrated in FIG. 1, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing apparatus 100 may have various functional units of a known computer other than the functional units illustrated in FIG. 1, for example, functional units such as various input devices and audio output devices.

The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 110 is a communication interface that is connected to the terminal device 10 via a network N in a wired or wireless manner and is in charge of communication of information with the terminal device 10. The communication unit 110 receives identification information, operation information, and the like from the terminal device 10. The communication unit 110 outputs the received identification information and operation information to the control unit 130. The communication unit 110 also transmits the AR content, various screens, and the like input from the control unit 130 to the terminal device 10.

The storage unit 120 is realized by, for example, a RAM, a semiconductor memory element such as a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 includes an inspection calendar storage unit 121, an inspection item storage unit 122, an AR content storage unit 123, and an abnormality information storage unit 124. In addition, the storage unit 120 stores information used for processing by the control unit 130.

The inspection calendar storage unit 121 stores the inspection calendar. FIG. 2 is a diagram illustrating an example of the inspection calendar storage unit. As shown in FIG. 2, the inspection calendar storage unit 121 includes items such as “task name”, “planned start date”, “planned end date”, “duration”, “charge ID”, “charge name”, and “memo”. Have. The inspection calendar storage unit 121 stores, for example, one record for each inspection.

The "task name" is information indicating the inspection task name and the number of times. The "task name" indicates, for example, the number of inspections of the projector A for one month in a year. The “scheduled start date” is information indicating the scheduled start date of the inspection task. The “scheduled end date” is information indicating the scheduled end date of the inspection task. “Period” is information indicating a task, that is, an inspection period. The “charge ID” is an identifier that identifies a maintenance person in charge of inspection. The “person in charge” is information indicating a maintenance person in charge of inspection. The “memo” is, for example, information such as items submitted to a maintenance person in charge of inspection. In the example on the first line in FIG. 2, the scheduled start date is “2015/01/06” and the scheduled end date is “2015” for the inspection of the task name “Monthly first time of projector A (equipment ID: E001)”. It indicates that the period is “01” and is “1” day. Further, the example of the first line indicates that the person in charge "maintenance person C" of the person in charge "H001" performs inspection.

Returning to the description of FIG. 1, the inspection item storage unit 122 stores the inspection items of the equipment. FIG. 3 is a diagram illustrating an example of the inspection item storage unit. As shown in FIG. 3, the inspection item storage unit 122 has items such as “equipment ID”, “equipment name”, “normal inspection item”, and “detailed inspection item”. The “normal inspection item” and the “detailed inspection item” each have a plurality of small items such as “item 1”, “item 2”, and “item 3”. The inspection item storage unit 122 stores, for example, one record for each equipment name.

The “equipment ID” is an identifier for identifying the equipment. As for the “equipment ID”, for example, equipment IDs such as “E001” and “E002” are given to the projector, and are shown as “E0xx” (x is a wild card) so as to include a plurality of projectors. Further, the “equipment ID” is indicated as “E1xx” so as to include a plurality of screens if the equipment ID is a screen to which equipment IDs such as “E101” and “E102” are assigned.

The “equipment name” is information indicating the name of the equipment. The "normal inspection item" is information indicating an inspection item in a normal state, that is, in a state where no abnormality is found. The “detailed inspection item” is, for example, information indicating an inspection item in a state in which an abnormality has occurred in the inspection target equipment or other equipment of the same type. In the example of the first line in FIG. 3, the equipment name “projector” with the equipment ID “E0xx” has “lamp accumulated time”, “filter cleaning”, and “light flux” as normal inspection items, and “detailed inspection items”. It has "focus", "optical axis" and "fan".

Returning to the description of FIG. 1, the AR content storage unit 123 stores the AR content corresponding to the facility. FIG. 4 is a diagram illustrating an example of the AR content storage unit. As shown in FIG. 4, the AR content storage unit 123 has items such as “equipment ID”, “content ID”, “AR content”, and “AR content when abnormality is detected in related equipment”. The AR content storage unit 123 stores, for example, for each equipment ID, a pair of AR contents corresponding to respective states in a normal state and an abnormal state and stored.

The “equipment ID” is an identifier for identifying the equipment. The "content ID" is an identifier for identifying the content. As for the "content ID", T is added to the end, for example, "C001T", in the AR content under normal conditions. Further, the "content ID" is added with F at the end, such as "C001F", for the AR content at the time of abnormality. “AR content” is information indicating the AR content. As the “AR content”, various contents such as characters, icons, still images, moving images can be used. As the “AR content”, for example, different AR content can be prepared for each facility depending on whether the facility is normal or abnormal.

“AR content when abnormality is detected in related equipment” is information indicating an AR content when abnormality is detected in related equipment. The "AR contents when abnormality is detected in related equipment" is displayed when the projector A and the projector B are related equipment and an abnormality occurs in the inspection of the projector A on the previous day, when the abnormality is detected in the projector B of the day. It is AR content. In the example of the 1st and 2nd lines in FIG. 4, if projector A is normal and projector B is normal, AR content with content ID “C001T” “please check the accumulated lamp time” is displayed. It Also, in the example of the 1st and 2nd lines, if projector A is normal and projector B is abnormal, check the AR content “Lamp burnout for content ID “C001F”. Please check the time” is displayed. Further, in the example of the first and second lines, if the projector A is abnormal and the projector B is normal, the AR content “lamp light flux at the time of abnormality detection at the related equipment with the content ID “C001T” is confirmed. Please replace the lamp with another projector." is displayed. Also, in the example of the 1st and 2nd lines, if projector A is abnormal and projector B is abnormal, please check the AR content "lamp out when abnormality is detected by related equipment with content ID "C001F". Another projector is replacing the lamp." is displayed.

Returning to the description of FIG. 1, the abnormality information storage unit 124 stores the abnormality that has occurred in the equipment and the response status. FIG. 5 is a diagram illustrating an example of the abnormality information storage unit. As shown in FIG. 5, the abnormality information storage unit 124 has items such as “equipment ID”, “equipment name”, “abnormality information”, and “correspondence status”. The abnormality information storage unit 124 stores, for example, one record for each equipment ID.

The “equipment ID” is an identifier for identifying the equipment. The “equipment name” is information indicating the name of the equipment. The "abnormality information" is information about the abnormality acquired from the facility where the abnormality has occurred. The “correspondence status” is information indicating a correspondence status for an abnormality. In the example on the first line in FIG. 5, “projector A” with equipment ID “E001” indicates that the abnormality information “lamp out” has been acquired and the maintenance person has performed “lamp replacement”. The "abnormality information" is, for example, abnormality information transmitted from the projector to the information processing apparatus 100 via the network N when the projector connected to the network N detects an abnormality. The "correspondence status" is, for example, information input from the terminal device 10 of the corresponding maintenance person.

The control unit 130 is realized by, for example, a CPU, an MPU, or the like executing a program stored in an internal storage device using a RAM as a work area. Further, the control unit 130 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The control unit 130 includes a receiving unit 131 and a providing unit 132, and realizes or executes the functions and actions of information processing described below. The internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 1, and may be another configuration as long as it is a configuration for performing information processing described later.

The operation information for starting the inspection is input from the terminal device 10 to the reception unit 131 via the network N and the communication unit 110. When the operation information for starting the inspection is input, the reception unit 131 refers to the inspection calendar storage unit 121 and the inspection item storage unit 122 to generate an inspection screen, and the generated inspection via the communication unit 110 and the network N. The screen is transmitted to the terminal device 10.

When receiving the identification information, that is, the identification ID of the projector, from the terminal device 10 via the network N and the communication unit 110, the reception unit 131 receives the identification ID. That is, the reception unit 131 receives the identification information of the AR marker attached to the projector. The reception unit 131 outputs the received identification ID to the provision unit 132.

When the identification ID is input from the reception unit 131, the providing unit 132 provides the AR content corresponding to the identification ID. First, in the case of inspecting the projector A, the case where the inspection of other projectors is not completed will be described.

When the identification ID is input from the receiving unit 131, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether an abnormality has been detected for the projector A. When the abnormality is not detected for the projector A, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector A at the normal time. That is, the providing unit 132 acquires AR content such as "please check the accumulated lamp time". The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

When an abnormality is detected in the projector A, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector A at the time of abnormality. That is, the providing unit 132 acquires the AR content such as “please check the lamp is out, also check the accumulated time of the lamps of other projectors”. The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

Next, when inspecting the projector B, a state in which the inspection of the projector A is completed will be described. The projector A is the first equipment, and the AR marker attached to the projector A is the first reference object. The projector B is the second facility, and the AR marker attached to the projector B is the second reference object.

When the identification ID is input from the receiving unit 131, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether an abnormality has been detected for the projector A. When the abnormality is not detected for the projector A, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether the abnormality is detected for the projector B. When no abnormality is detected in the projector B, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B in the normal state. That is, the providing unit 132 acquires AR content such as "please check the accumulated lamp time". The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

When an abnormality is detected in the projector B, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B at the time of abnormality. That is, the providing unit 132 acquires the AR content such as “please check the lamp is out, also check the accumulated time of the lamps of other projectors”. The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

When the abnormality is detected for the projector A, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether the abnormality is detected for the projector B. When no abnormality is detected in the projector B, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B when the abnormality is detected in the projector A. That is, the providing unit 132 acquires the AR content such as “please check the luminous flux of the lamp, lamp replacement is occurring in another projector”. The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

When an abnormality is detected in the projector B, the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B when the abnormality is detected in the projectors A and B. That is, the providing unit 132 acquires the AR content such as “please check lamp out, lamp replacement is occurring in another projector”. The providing unit 132 transmits the acquired AR content to the terminal device 10 via the communication unit 110 and the network N, and provides the AR content.

Here, the display of the AR content on the inspection screen will be described with reference to FIGS. 6 to 8. FIG. 6 is a diagram showing an example of the inspection screen. The inspection screen 20 shown in FIG. 6 is displayed on the display operation unit 13 of the terminal device 10. The inspection screen 20 is a screen when the maintenance person C inspects the projector A when no abnormality is detected in the projectors A and B. The inspection screen 20 includes, for example, an area 21 for displaying a captured image input from the input unit 12, a result transmission button 22, an inspection item list button 23, a report list button 24, an inspection reference button 25, and equipment. It has a drawing button 26 and a manual button 27.

The result transmission button 22 is a button for transmitting the inspection result to the information processing device 100. The inspection item list button 23 is a button for displaying a list screen as an inspection item list. The report list button 24 is a button for displaying a list of report items. The inspection standard button 25 is a button for displaying the inspection standard. The equipment drawing button 26 is a button for displaying an equipment drawing. The manual button 27 is a button for displaying a manual of the equipment.

Further, the inspection screen 20 has, for example, a report item column 28 and an inspection input column 29. The item to be submitted column 28 displays items to be submitted. The inspection input column 29 has an inspection item 30, an inspection result column 31, and buttons 32a and 32b for changing the display of the inspection item.

In the area 21, for example, a projector 33, which is a facility to be inspected, is displayed. Further, in the area 21, for example, based on the identification information of the AR marker 34 attached to the projector 33, the AR content 35 indicating the equipment name “projector A” of the projector 33 and the AR content 36 regarding the inspection item are displayed. To be done. Further, in the area 21, for example, a button 37 for returning to the beginning of the inspection process, a button 38 for returning to the previous inspection process, for example, the button for returning to the inspection of the previous projector, and a next inspection process, for example, the next button A button 39 for proceeding to the inspection of the projector is displayed. For example, the maintenance person C confirms the AR content 36 on the inspection screen 20 and confirms the cumulative time of the lamp of the projector A.

FIG. 7 is a diagram showing another example of the inspection screen. The inspection screen 40 shown in FIG. 7 is displayed on the display operation unit 13 of the terminal device 10. The inspection screen 40 is a screen when the maintenance person C inspects the projector A when an abnormality is detected in the projector A and no abnormality is detected in the projector B. Compared to the inspection screen 20, the inspection screen 40 has the AR content corresponding to the projector A switched to the AR content 41 when an abnormality is detected. In this case, for example, the maintenance person C confirms the AR content 41 on the inspection screen 40, confirms that the lamp of the projector A has burned out, and replaces the lamp. Further, the maintenance person C confirms the accumulated time of the lamp of the projector B which is another projector.

FIG. 8 is a diagram showing another example of the inspection screen. The inspection screen 50 shown in FIG. 8 is displayed on the display operation unit 13 of the terminal device 10. The inspection screen 50 is a screen displayed when the maintenance person D inspects the projector B in which no abnormality is detected, when the abnormality is detected in the projector A previously inspected by the maintenance person C and the lamp is replaced. is there. On the inspection screen 50, for example, a projector 52, which is a facility to be inspected, is displayed in the area 51. Further, in the area 51, for example, based on the identification information of the AR marker 53 attached to the projector 52, the AR content 53 indicating the facility name “projector B” of the projector 52 and the AR content 54 regarding the inspection item are displayed. To be done. Further, in the inspection input field 55, based on the abnormality detection in the projector A, the inspection item 56 that affects the projector B, that is, the inspection item 56 of the luminous flux is preferentially displayed in order to inspect the brightness of the lamp. It The inspection input field 55 may display detailed inspection items as inspection items that affect the projector B, for example, in addition to the normal inspection items.

On the inspection screen 50, the AR content corresponding to the projector B is switched from the normal AR content to the AR content 54 when abnormality is detected in the related equipment. In this case, the maintenance person D confirms the AR content 54 on the inspection screen 50, for example, and confirms that the lamp replacement of the projector B, which is another projector, has occurred and confirms the luminous flux of the lamp of the projector B. To do.

Next, the list screen displayed when the inspection item list button 23 is pressed on the inspection screen 20 will be described. FIG. 9 is a diagram showing an example of the list screen. On the list screen 60 shown in FIG. 9, a check item list 61 and a close button 62 are displayed. The list 61 has, as items, an item name 63, a current value 64, a previous value 65, and a determination standard 66. As the item name 63, the item name of the inspection item is displayed. The current inspection result is input as the current value 64. As the previous value 65, the previous inspection result is displayed. As the judgment criteria 66, the inspection judgment criteria, work contents, etc. are displayed. The close button 62 is a button for closing the list screen 60. The maintenance person D may input the inspection result on the inspection screen 50, or may input the inspection result on the list screen 60 after inspecting a plurality of inspection items.

Next, the operation of the inspection support system 1 of the embodiment will be described. First, in the case of inspecting the projector A, the first support process in a state where the inspection of the other projectors is not completed will be described. FIG. 10 is a flowchart showing an example of the first support process of the embodiment.

When the operation information to start the inspection is input from the display operation unit 13, the control unit 15 of the terminal device 10 transmits the operation information to start the inspection to the information processing device 100. When the operation information for starting the inspection is input from the terminal device 10, the reception unit 131 of the information processing apparatus 100 refers to the inspection calendar storage unit 121 and the inspection item storage unit 122 to generate an inspection screen, and the generated inspection screen. Is transmitted to the terminal device 10.

Upon receiving the inspection screen from the information processing device 100, the control unit 15 of the terminal device 10 causes the display operation unit 13 to display the received inspection screen. Further, when the captured image obtained by capturing the image of the projector A is input from the input unit 12, the control unit 15 detects the AR marker from the captured image. The control unit 15 acquires the identification ID from the detected AR marker. The control unit 15 transmits the acquired identification ID to the information processing device 100.

When receiving the identification ID from the terminal device 10, the reception unit 131 of the information processing apparatus 100 receives the identification ID. That is, the reception unit 131 receives the identification ID of the AR marker attached to the projector A (step S1). The reception unit 131 outputs the received identification ID to the provision unit 132.

When the identification ID is input from the receiving unit 131, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether an abnormality has been detected for the projector A (step S2). When the abnormality is not detected for the projector A (step S2: No), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector A in the normal state. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S3).

When an abnormality is detected in the projector A (step S2: Yes), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector A at the time of abnormality. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S4).

When the AR content is received from the information processing apparatus 100, the control unit 15 of the terminal device 10 displays the received AR content, for example, as shown in the inspection screen 20 of FIG. Thereby, the information processing apparatus 100 can display the information necessary for facility inspection.

Next, when the projector B is inspected, the second support process in a state where the inspection of the projector A is completed will be described. FIG. 11 is a flowchart showing an example of the second support process of the embodiment.

When the operation information to start the inspection is input from the display operation unit 13, the control unit 15 of the terminal device 10 transmits the operation information to start the inspection to the information processing device 100. When the operation information for starting the inspection is input from the terminal device 10, the reception unit 131 of the information processing apparatus 100 refers to the inspection calendar storage unit 121 and the inspection item storage unit 122 to generate an inspection screen, and the generated inspection screen. Is transmitted to the terminal device 10.

Upon receiving the inspection screen from the information processing device 100, the control unit 15 of the terminal device 10 causes the display operation unit 13 to display the received inspection screen. Further, when the captured image obtained by capturing the image of the projector B is input from the input unit 12, the control unit 15 detects the AR marker from the captured image. The control unit 15 acquires the identification ID from the detected AR marker. The control unit 15 transmits the acquired identification ID to the information processing device 100.

When receiving the identification ID from the terminal device 10, the reception unit 131 of the information processing apparatus 100 receives the identification ID. That is, the reception unit 131 receives the identification ID of the AR marker attached to the projector B (step S11). The reception unit 131 outputs the received identification ID to the provision unit 132.

When the identification ID is input from the receiving unit 131, the providing unit 132 refers to the abnormality information storage unit 124 and determines whether an abnormality has been detected for the projector A (step S12). When the abnormality is not detected for the projector A (step S12: No), the providing unit 132 refers to the abnormality information storage unit 124 and determines whether the abnormality is detected for the projector B (step S13). When no abnormality is detected for the projector B (step S13: No), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B in the normal state. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S14).

When an abnormality is detected in the projector B (step S13: Yes), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content related to the projector B in the abnormality. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S15).

When the abnormality is detected for the projector A (step S12: Yes), the providing unit 132 refers to the abnormality information storage unit 124 and determines whether the abnormality is detected for the projector B (step S16). When the abnormality is not detected for the projector B (step S16: No), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content for the projector B when the abnormality is detected in the projector A. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S17).

When an abnormality is detected in the projector B (step S16: Yes), the providing unit 132 refers to the AR content storage unit 123 and acquires the AR content regarding the projector B when the abnormality is detected in the projectors A and B. .. The providing unit 132 transmits the acquired AR content to the terminal device 10 and provides the AR content (step S18).

Upon receiving the AR content from the information processing apparatus 100, the control unit 15 of the terminal device 10 displays the received AR content, for example, as shown in the inspection screen 50 of FIG. 8. The AR content 54 of the inspection screen 50 is an example of the AR content provided in step S17. As a result, the information processing apparatus 100 displays the AR content corresponding to the inspection result of the other projector, and thus can display the information necessary for the equipment inspection. Further, the information processing apparatus 100 can share the abnormality information even if the persons who inspect the plurality of facilities are different.

As described above, the information processing apparatus 100 provides the AR content corresponding to the received identification information in response to the reception of the identification information of the reference object. In addition, the information processing apparatus 100 switches the AR content to be provided depending on whether an abnormality is detected in the facility or not. As a result, information necessary for facility inspection can be displayed.

Further, in the information processing apparatus 100, when no abnormality is detected in the equipment, information including inspection items regarding the equipment is included, and when abnormality is detected in the equipment, information indicating inspection of other equipment related to the equipment is included. including. As a result, it is possible to display information about the equipment that causes the abnormality.

In addition, the information processing apparatus 100 provides AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility. Further, when the information processing apparatus 100 receives the identification information of the first reference object arranged in association with the first equipment, an abnormality is detected in the second equipment associated with the first equipment. It is controlled to provide different AR contents regarding the first equipment depending on whether or not an abnormality is detected. As a result, preventive inspections can be proposed for similar equipment.

In addition, the information processing apparatus 100, when an abnormality is detected in the second equipment associated with the first equipment, is compared with a case in which no abnormality is detected, among the inspection items of the first equipment, Providing that inspection items that affect the second facility are displayed in large numbers or in priority. As a result, it is possible to propose an inspection for an inspection item having a higher priority.

In addition, in the above-described embodiment, the AR content that suggests the inspection of the equipment related to the equipment in which the abnormality is detected is displayed, but the present invention is not limited to this. For example, when the equipment in which an abnormality is detected is to be stopped urgently, the procedure for stopping the equipment may be displayed as AR content. As a result, it is possible to prevent damage to the equipment due to failure to follow the equipment shutdown procedure.

Further, in the above-described embodiment, the abnormality information is collected from the projector, which is the facility, to the information processing apparatus 100 via the network N, but the present invention is not limited to this. For example, the inspection result may be input by the maintenance person who performed the inspection.

In addition, each component of each unit illustrated does not necessarily have to be physically configured as illustrated. That is, the specific form of distribution/integration of each part is not limited to that shown in the figure, and all or part of the part may be functionally or physically distributed/integrated in arbitrary units according to various loads and usage conditions. Can be configured. For example, the receiving unit 131 and the providing unit 132 may be integrated. In addition, the illustrated processes are not limited to the order described above, and may be executed simultaneously or in a different order as long as the contents of the processes are not inconsistent.

Further, various processing functions performed by each device may be executed in whole or in part on a CPU (or a microcomputer such as MPU or MCU (Micro Controller Unit)). Further, various processing functions may be executed in whole or in part on a program analyzed and executed by a CPU (or a microcomputer such as MPU or MCU) or on hardware by a wired logic. It goes without saying that it is good.

The various processes described in the above embodiments can be realized by executing a program prepared in advance on a computer. Therefore, an example of a computer that executes a program having the same functions as those in the above-described embodiments will be described below. FIG. 12 is a diagram illustrating an example of a computer that executes the facility inspection support program.

As shown in FIG. 12, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives data input, and a monitor 203. The computer 200 also includes a medium reading device 204 that reads a program or the like from a storage medium, an interface device 205 for connecting to various devices, and a communication device 206 for connecting to another information processing device or the like by wire or wirelessly. Have. The computer 200 also has a RAM 207 for temporarily storing various information and a hard disk device 208. Further, each of the devices 201 to 208 is connected to the bus 209.

The hard disk device 208 stores an equipment inspection support program having the same functions as the processing units of the reception unit 131 and the provision unit 132 illustrated in FIG. 1. Further, the hard disk device 208 stores an inspection calendar storage unit 121, an inspection item storage unit 122, an AR content storage unit 123, an abnormality information storage unit 124, and various data for realizing the facility inspection support program. The input device 202 receives input of various information such as operation information and management information from the administrator of the computer 200, for example. The monitor 203 displays various screens such as a screen of management information for the administrator of the computer 200, for example. A printing device or the like is connected to the interface device 205, for example. The communication device 206 has the same function as the communication unit 110 shown in FIG. 1, for example, is connected to the network N, and exchanges various information with the terminal device 10.

The CPU 201 performs various processes by reading out each program stored in the hard disk device 208, expanding the program in the RAM 207, and executing the program. Moreover, these programs can cause the computer 200 to function as the reception unit 131 and the provision unit 132 illustrated in FIG. 1.

The facility inspection support program described above does not necessarily have to be stored in the hard disk device 208. For example, the computer 200 may read and execute a program stored in a storage medium readable by the computer 200. The storage medium readable by the computer 200 corresponds to, for example, a CD-ROM, a DVD disk, a portable recording medium such as a USB (Universal Serial Bus) memory, a semiconductor memory such as a flash memory, a hard disk drive, or the like. Alternatively, the equipment inspection support program may be stored in a device connected to a public line, the Internet, a LAN or the like, and the computer 200 may read the equipment inspection support program from these and execute it.

As described above, the following additional notes are disclosed regarding the embodiment including the present embodiment.

(Supplementary Note 1) In an equipment inspection support program for causing a computer to execute a process of providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object,
Switching the AR content to be provided depending on whether an abnormality is detected in the equipment or not.
An equipment inspection support program that causes a computer to execute processing.

(Supplementary Note 2) If no abnormality is detected in the equipment, information including an inspection item regarding the equipment is included, and if abnormality is detected in the equipment, information indicating inspection of other equipment related to the equipment is included. including,
The facility inspection support program described in Appendix 1, which is characterized in that

(Supplementary Note 3) In a facility inspection support program for causing a computer to execute a process of providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility,
When the identification information of the first reference object arranged in association with the first equipment is received, an abnormality has been detected or an abnormality has been detected for the second equipment associated with the first equipment. Control to provide different AR content for the first facility,
An equipment inspection support program that causes a computer to execute processing.

(Supplementary Note 4) In the case where an abnormality is detected in the second equipment associated with the first equipment, as compared with the case where no abnormality is detected, in the inspection items of the first equipment, Providing that many inspection items that affect the equipment of 2 are displayed with priority or priority,
The facility inspection support program described in Appendix 3, which is characterized in that

(Supplementary Note 5) In the equipment inspection support method for providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object,
Switching the AR content to be provided depending on whether an abnormality is detected in the equipment or not.
A facility inspection support method characterized in that a computer executes the processing.

(Supplementary Note 6) If no abnormality is detected in the equipment, information including an inspection item regarding the equipment is included, and if an abnormality is detected in the equipment, information that suggests inspection of another equipment related to the equipment including,
The equipment inspection support method described in Appendix 5, which is characterized in that

(Supplementary Note 7) In the equipment inspection support method for providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the equipment,
When the identification information of the first reference object arranged in association with the first equipment is received, an abnormality has been detected or an abnormality has been detected for the second equipment associated with the first equipment. Control to provide different AR content for the first facility,
A facility inspection support method characterized in that a computer executes the processing.

(Supplementary Note 8) In the case where an abnormality is detected in the second equipment associated with the first equipment, as compared with the case where no abnormality is detected, among the inspection items of the first equipment, Providing that many inspection items that affect the equipment of 2 are displayed with priority or priority,
The equipment inspection support method described in appendix 7, characterized in that

(Supplementary Note 9) In an information processing device that provides AR content corresponding to the received identification information in response to the reception of the identification information of the reference object,
A control unit for switching the AR content to be provided depending on whether an abnormality is detected in the facility or not.
An information processing apparatus comprising:

(Supplementary Note 10) When no abnormality is detected in the equipment, information including an inspection item regarding the equipment is included, and when an abnormality is detected in the equipment, information that suggests inspection of another equipment related to the equipment including,
The information processing apparatus according to appendix 9, characterized in that.

(Supplementary Note 11) In an information processing device which provides AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility,
When the identification information of the first reference object arranged in association with the first equipment is received, an abnormality has been detected or an abnormality has been detected for the second equipment associated with the first equipment. A control unit for controlling to provide different AR contents related to the first facility,
An information processing apparatus comprising:

(Supplementary Note 12) The control unit, when an abnormality is detected in the second equipment associated with the first equipment, is an inspection item of the first equipment as compared with a case where no abnormality is detected. Among them, the inspection items that affect the second facility are provided so as to be displayed in a large number or in priority.
The information processing apparatus according to appendix 11, characterized in that.

1 Inspection Support System 10 Terminal Device 11 Communication Unit 12 Input Unit 13 Display Operation Unit 14 Storage Unit 15 Control Unit 100 Information Processing Device 110 Communication Unit 120 Storage Unit 121 Inspection Calendar Storage Unit 122 Inspection Item Storage Unit 123 AR Content Storage Unit 124 Abnormality Information storage unit 130 Control unit 131 Reception unit 132 Providing unit N network

Claims (4)

In a facility inspection support program for causing a computer to execute a process of providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility,
For the first equipment inspected by the first maintenance person who inspects the first equipment, when the detected abnormality is processed, the second equipment associated with the first equipment is detected. When the identification information of the reference object arranged in association with the second facility is received from the terminal device of the second maintenance person who performs the inspection, the content of the process for the abnormality detected by the first facility, AR contents including that the inspection items of the second equipment related to the contents are preferentially displayed including the detailed inspection items , and an inspection input field for receiving the input of the inspection result. Control is performed so as to provide the inspection input field that displays the inspection items of the related second facility including the detailed inspection items with priority to the terminal device of the second maintenance person.
An equipment inspection support program that causes a computer to execute processing. The AR content and the inspection input field indicate the information contained in the AR content and the inspection item in the inspection input field when an abnormality is detected in the second facility and when no abnormality is detected. different causes, in the case where the abnormality in the second equipment is detected, the include stopping procedure for an emergency stop the second equipment to the AR content,
The facility inspection support program according to claim 1, wherein: In a facility inspection support method for providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility,
For the first equipment inspected by the first maintenance person who inspects the first equipment, when the detected abnormality is processed, the second equipment associated with the first equipment is detected. When the identification information of the reference object arranged in association with the second facility is received from the terminal device of the second maintenance person who performs the inspection, the content of the process for the abnormality detected by the first facility, AR contents including that the inspection items of the second equipment related to the contents are preferentially displayed including the detailed inspection items , and an inspection input field for receiving the input of the inspection result. Control is performed so as to provide the inspection input field that displays the inspection items of the related second facility including the detailed inspection items with priority to the terminal device of the second maintenance person.
A facility inspection support method characterized in that a computer executes the processing. In an information processing device for providing AR content corresponding to the received identification information in response to the reception of the identification information of the reference object arranged in association with the facility,
For the first equipment inspected by the first maintenance person who inspects the first equipment, when the detected abnormality is processed, the second equipment associated with the first equipment is detected. When the identification information of the reference object arranged in association with the second facility is received from the terminal device of the second maintenance person who performs the inspection, the content of the process for the abnormality detected by the first facility, AR contents including that the inspection items of the second equipment related to the contents are preferentially displayed including the detailed inspection items , and an inspection input field for receiving the input of the inspection result. A control unit that controls to provide the inspection input field that displays the inspection item of the related second facility including the detailed inspection item with priority to the terminal device of the second maintenance person.
An information processing apparatus comprising:

Images