CN115552446B - Maintenance management operation support device and maintenance management operation portable terminal - Google Patents

Maintenance management operation support device and maintenance management operation portable terminal Download PDF

Info

Publication number
CN115552446B
CN115552446B CN202080100860.6A CN202080100860A CN115552446B CN 115552446 B CN115552446 B CN 115552446B CN 202080100860 A CN202080100860 A CN 202080100860A CN 115552446 B CN115552446 B CN 115552446B
Authority
CN
China
Prior art keywords
information processing
maintenance management
attribute
unit
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080100860.6A
Other languages
Chinese (zh)
Other versions
CN115552446A (en
Inventor
妻鹿利宏
川崎仁
齐藤启太
冈里笃
大谷晋一郎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Building Solutions Corp
Original Assignee
Mitsubishi Electric Building Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Building Solutions Corp filed Critical Mitsubishi Electric Building Solutions Corp
Publication of CN115552446A publication Critical patent/CN115552446A/en
Application granted granted Critical
Publication of CN115552446B publication Critical patent/CN115552446B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services

Landscapes

  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Tourism & Hospitality (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Accounting & Taxation (AREA)
  • General Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

In an auxiliary server (60) as a maintenance management job auxiliary device, attribute data indicating attributes related to building equipment or maintenance management jobs and processing object data used in the maintenance management jobs are acquired from a portable terminal (20) used in the maintenance management jobs of the building equipment (S16). Then, according to a selection rule set for the attribute, an information processing service to be an execution request is selected from a plurality of information processing services of the same type provided by a plurality of external systems (130, 140, 150) (S20). Next, an API corresponding to the selected information processing service is called, and the processing target data is transmitted to request execution of the information processing service (S26). Further, the execution result of the information processing service is received through the API (S28). The received execution result of the information processing service is transmitted to the portable terminal (S36).

Description

Maintenance management operation support device and maintenance management operation portable terminal
Technical Field
The present invention relates to a maintenance management operation support device and a maintenance management operation mobile terminal used for maintenance management operation of building equipment.
Background
In maintenance management work for building equipment, information processing services such as OCR (Optical Character Recognition: optical character recognition) provided by an external system may be used. External systems are typically built to be utilized through APIs (Application Programming Interface: application program interfaces) provided by the external systems.
In many cases, similar information processing services are provided by a plurality of external systems. Further, the results obtained by the respective information processing services differ for each external system. In addition, in the external system, the algorithm of the program responsible for the information processing service may be changed without notifying the user. Therefore, even in the case of using the same information processing service of the same external system, a situation in which the result differs according to the timing may be seen. Therefore, if an optimal information processing service can be selected from a plurality of external systems, it is considered that the efficiency of maintenance management work is improved.
Patent document 1 below describes the following: an OCR server satisfying the conditions such as the evaluation value and the processing speed is selected from a plurality of OCR servers connected to a network, and a document image is transmitted.
Prior art literature
Patent literature
Patent document 1: japanese patent laid-open No. 2008-293354
Disclosure of Invention
Problems to be solved by the invention
Maintenance management of building equipment involves many aspects. Further, for example, even in the same equipment, the content of the maintenance management job may be different depending on the manufacturer, model, and the like. In addition, in the maintenance management work, work environments such as a place and time of execution are also various. Therefore, it is difficult to determine an appropriate information processing service without distinction from the same information processing service of a plurality of external systems. The technique described in patent document 1 is merely a technique for selecting an OCR server with respect to a document image obtained in a somewhat homogeneous environment, and is difficult to apply to maintenance management work of building equipment.
The purpose of the present invention is to appropriately select an information processing service of an external system used in a maintenance management job of a building device.
Means for solving the problems
The maintenance management work support device of the present invention comprises: an acquisition unit that acquires, from a portable terminal used in a maintenance management job of a building device, attribute data indicating an attribute related to the building device or the maintenance management job, and processing target data used in the maintenance management job; a selection unit that selects an information processing service that is a request target of execution from among a plurality of information processing services of the same kind provided by a plurality of external systems, in accordance with a selection rule set for the attribute; a request unit that calls an API corresponding to the selected information processing service, transmits the processing object data, and requests execution of the information processing service; a receiving unit that receives an execution result of the information processing service through the API; and a transmitting unit that transmits the received execution result of the information processing service to the portable terminal, the maintenance management job support device having an updating unit that selects a plurality of identical information processing services provided by the plurality of external systems, requests execution by the requesting unit and receives the execution result by the receiving unit, compares the received execution result of each information processing service, and updates the selection rule set for the attribute.
In one aspect of the present invention, the receiving means acquires accuracy data of the execution result together with the execution result, and the updating means updates the selection rule so that an information processing service that has acquired the execution result with high accuracy is an information processing service that is a request target related to the attribute.
In one aspect of the present invention, the updating means updates the selection rule so that the information processing service that has obtained the execution result with high accuracy is the information processing service that is the request target related to the attribute, by transmitting the execution result of each information processing service to the mobile terminal by the transmitting means and acquiring data of the correctness of the execution result of each information processing service from the mobile terminal.
The maintenance management work support device of the present invention comprises: an acquisition unit that acquires, from a portable terminal used in a maintenance management job of a building device, attribute data indicating an attribute related to the building device or the maintenance management job, and processing target data used in the maintenance management job; a selection unit that selects 2 or more information processing services as execution request targets from among a plurality of information processing services of the same type provided by a plurality of external systems, in accordance with a selection rule set for the attribute; a request unit that calls an API corresponding to the selected 2 or more information processing services, and transmits the processing target data to request execution of the information processing services; a receiving unit that receives execution results of the selected 2 or more information processing services through the API; a determination unit that compares execution results of the 2 or more information processing services received by the reception unit, and determines execution results of 1 information processing service to be transmitted; and a transmitting unit that transmits the execution result of the 1 information processing services determined by the determining unit to the portable terminal.
In one aspect of the present invention, the receiving means acquires data of accuracy of the execution result together with the execution result, and the determining means determines an information processing service that has acquired the execution result with high accuracy as the transmission target.
The maintenance management operation portable terminal of the present invention comprises: a data acquisition unit that acquires processing target data used for maintenance management work of building equipment; an attribute acquisition unit that acquires attribute data indicating an attribute related to the building equipment or the maintenance management job; a request unit that transmits the processing object data and the attribute data, requesting an information processing service for the processing object data; a result acquisition unit that acquires execution results of information processing services selected based on the attribute among a plurality of identical information processing services provided by a plurality of external systems; and a receiving unit that receives a beacon transmitted from the building device, wherein the attribute acquiring unit acquires the attribute data from the received beacon.
In one aspect of the present invention, the processing target data is image data obtained by capturing an image of the display of the building equipment, the information processing service is an OCR service that generates a character code for specifying the building equipment as the execution result from the image data, the beacon is a signal including data for specifying the building equipment, the attribute data acquired by the attribute acquisition unit includes data for specifying the building equipment, and the maintenance management work portable terminal includes a determination unit that compares the character code acquired by the result acquisition unit with the data for specifying the building equipment acquired by the attribute acquisition unit, and determines whether the display of the building equipment or the beacon is mismatched.
Effects of the invention
According to the present invention, it is possible to appropriately select an information processing service of an external system used in a maintenance management job of a building device according to the building device or the maintenance management job, thereby obtaining a highly accurate execution result.
Drawings
Fig. 1 is a diagram of an overall structure of a maintenance management job support system.
Fig. 2 is a block diagram showing a hardware configuration of the mobile terminal.
Fig. 3 is a block diagram showing a functional configuration of the mobile terminal.
Fig. 4 is a block diagram showing a hardware configuration of the assist server.
Fig. 5 is a block diagram showing a functional configuration of the assist server.
Fig. 6 is a block diagram showing a functional configuration of an external system.
Fig. 7 is a timing chart of the maintenance management job support system.
Fig. 8 is a diagram schematically showing an example of the sign.
Fig. 9 is a diagram showing an example of a transmission screen of image data in a mobile terminal.
Fig. 10 is a diagram showing an example of a selection rule.
Fig. 11 is a diagram showing an example of accuracy in the execution result of OCR.
Fig. 12 is a diagram showing a display example of the execution result of OCR in the mobile terminal.
Detailed Description
(1) Structure of system
An example of a system configuration according to the embodiment will be described with reference to fig. 1 to 6.
Fig. 1 is a diagram schematically showing the overall configuration of a maintenance management work support system 10 according to the embodiment. The maintenance management work support system 10 is a system that is used by a maintenance person 300 who performs maintenance management of building equipment in a maintenance management work. Here, the building equipment means equipment provided in a building and provided for using the building. In fig. 1, an outdoor unit 310 of an air conditioning system is illustrated as an example of a building device. In many building facilities, an air conditioning system including an outdoor unit 310, an indoor unit, and a refrigerant circuit is provided, and maintenance personnel 300 periodically perform maintenance management. In addition to an air conditioning system, various devices such as an electric device, a lighting device, a fire protection device, an elevator, an escalator, a water supply channel, a sewer, and a room entrance/exit safety system are provided in the building device.
The maintenance person 300 is an employee of a maintenance management company that performs maintenance management of building equipment. The maintenance person 300 performs maintenance management work according to a manual or the like. The maintenance management work includes spot inspection work, replacement/repair work for defective parts, and the like. In the maintenance management job, a job corresponding to the type, form, and the like of the building equipment is performed. For example, the outdoor unit 310 is provided with a sign 312 by a manufacturer, and the maintenance personnel 300 performs maintenance management work by appropriately referring to the sign 312.
The maintenance management work support system 10 includes a mobile terminal 20, a support server 60, a central monitoring device 110, the internet 120, an external system a 130, an external system B140, and an external system C150.
The mobile terminal 20 is an example of a maintenance management work mobile terminal, and is a computer carried by a maintenance person 300. The assist server 60 is a computer configured to be communicable with the mobile terminal 20 and assist the maintenance management work of the maintenance person 300. The central monitoring device 110 is a computer that is installed in a central monitoring room or the like of a building installed in a building facility and controls the building facility. The internet 120 is a communication network that connects the assist server 60 to the external system a 130, the external system B140, the external system C150, and the like in a communicable manner. The external systems a 130, B140, and C150 are computer systems operated by other enterprises, respectively, and provide a plurality of information processing services.
The mobile terminal 20 will be described in detail with reference to fig. 2 and 3. Fig. 2 is a diagram schematically showing a hardware configuration of the portable terminal 20. Fig. 3 is a schematic diagram showing functions built in the mobile terminal 20.
The portable terminal 20 is constructed using, for example, a smart phone, a tablet computer, a notebook PC (personal computer), or the like. As shown in fig. 2, the portable terminal 20 has a bus 22, a processor 24 connected to the bus 22, a memory 26, a touch panel 28, a communication circuit 30, a camera 32, and a microphone 34. The processor 24 is configured by an arithmetic processing device such as a CPU (Central Processing Unit: central processing unit) and a GPU (Graphics Processing Unit: graphics processing unit). In fig. 2, these 1 or more arithmetic processing devices are symbolically denoted as processor 24.
Memory 26 is a device that stores software and data. As the memory 26, 1 or more semiconductor memories, magnetic disks, or the like are used.
The touch panel 28 is a display capable of touch operation. The touch panel 28 is a display device in the portable terminal 20, and is an input device. The mobile terminal 20 may include mechanical buttons, a keyboard, a mouse, and the like in addition to the touch panel 28.
The communication circuit 30 is a circuit for connecting to a network such as the internet 120. The camera 32 is a device that captures moving images and still images and converts them into image data, and the microphone 34 is a device that converts sound into sound data.
As shown in fig. 3, the mobile terminal 20 includes an attribute information input unit 40, an integrated API (Application Programming Interface: application program interface) calling unit 42, a beacon receiving unit 44, a display unit 50, and an execution result accuracy input unit 52, in addition to the camera 32 and the microphone 34. They are constructed by controlling hardware of the portable terminal 20 with software such as an OS (operating system), an application (application program), and the like.
The camera 32 is an example of a data acquisition means, and acquires image data, which is data to be processed, by an operation of the maintenance person 300. The microphone 34 is also an example of a data acquisition means, and acquires audio data as processing target data by the operation of the maintenance person 300.
The attribute information input unit 40 is an example of an attribute acquisition means for acquiring attribute data indicating an attribute related to a building facility or a maintenance management job. The attribute related to the building device refers to information indicating characteristics of the building device, such as the type of the building device, the manufacturer name of the building device, the form of the building device, the place where the building device is installed, and the like. The types of building equipment refer to air conditioning, electrical, lighting, and the like. The manufacturer name of building equipment refers to the name of the business that makes or sells the building equipment. The form of a building device typically refers to identification information that a manufacturer imparts to each device that varies in specification.
The attribute related to the maintenance management job is information indicating the characteristics of the maintenance management job, such as the type of the maintenance management job, the place where the maintenance management job is performed, the name of the maintenance person who performs the maintenance management job, and the time when the maintenance management job is performed. Here, the types of maintenance and repair operations include types related to building equipment such as air conditioning, electricity, and lighting, and types of operation methods such as spot inspection, repair, and replacement. The place where the maintenance and management work is performed can be indicated by a large classification such as outdoors, indoors, etc., a classification in rooftops, underground, hallways, stairways, toilets, indoors, good layers, etc., a small classification such as good layer good number room, good layer tenant good interior, etc.
The attribute information input unit 40 is configured to receive an operation of the touch panel 28 by the maintenance person 300, for example, and acquire attribute data. Alternatively, it is also possible to estimate and automatically set the attribute based on the screen state of the application, the position information of the GNSS (Global Navigation Satellite System: global navigation satellite System), or the like, in consideration of the application of the portable terminal 20 operated by the maintainer 300. Of course, the result of the automatic setting may be a result that can be changed by the maintenance person 300. In another aspect, it is conceivable to read an RFID (Radio Frequency IDentifier: radio frequency identifier) or the like provided in a building device and acquire attribute data from information contained in the RFID or the like.
The unified API calling unit 42 is an example of a service requesting unit that requests the assist server 60 to execute the information processing service. The request is made by transmitting the image data from the camera 32 or the sound data from the microphone 34, and the attribute data from the attribute information input section 40. The unified API calling unit 42 is also an example of a result acquisition means, and receives the execution result of the information processing service from the assist server 60.
The beacon receiving unit 44 is an example of a beacon receiving means, and receives a beacon, which is a wireless signal transmitted from a building device. Beacons typically contain information about attributes associated with building devices, such as the class of device. The beacon receiving unit 44 is provided with an attribute acquiring unit 46 and an attribute accuracy determining unit 48. The attribute obtaining unit 46 is an example of an attribute obtaining means, and analyzes the beacon to obtain attribute data related to the building equipment. The attribute correctness determination unit 48 is an example of a determination means, and when the integrated API call unit 42 receives the execution result of the information processing service from the auxiliary server 60, compares the execution result with the attribute data obtained from the beacon when the execution result includes the attribute data. If the comparison results in a mismatch between the two, the meaning is displayed on the display unit 50 or the like, and the maintenance person 300 is given the opportunity to correct the mismatch.
The display unit 50 is formed by the touch panel 28, and performs various kinds of display such as display for operation and display of execution results of the information processing service. In addition, when the display result of the information processing service displayed on the display unit 50 is incorrect, the maintenance person 300 can input correction.
The execution result correctness input unit 52 is provided for inputting whether or not the result displayed on the display unit 50 is correct by the maintenance person 300. The input result can also be used to evaluate the execution result of the information processing service by the external system a 130, the external system B140, the external system C150, or the like.
The assist server 60 will be described in detail with reference to fig. 4 and 5. Fig. 4 is a diagram schematically showing a hardware configuration of the assist server 60. Fig. 5 is a schematic diagram showing functions built in the assist server 60.
The assist server 60 is an example of a maintenance management work assist device, and is a computer installed in a building, a maintenance management company, or the like in which building equipment is installed. The assist server 60 is constructed using a computer such as a PC. As shown in fig. 4, the assist server 60 has a bus 62, a processor 64 connected to the bus 62, a memory 66, a touch panel 68, and a communication circuit 70. The processor 64, the memory 66, the touch panel 68, and the communication circuit 70 are the same hardware as the processor 24, the memory 26, the touch panel 28, and the communication circuit 30 of the portable terminal 20 shown in fig. 2, and the description thereof is omitted.
The assist server 60 controls hardware of the assist server 60 with software such as an OS and an application, thereby constructing the functions shown in fig. 5. As shown in fig. 5, the assist server 60 includes an integrated API management unit 80, an individual API call unit 82, an API selection unit 90, a selection rule holding unit 94, a selection rule setting/updating unit 96, and a result determination/accumulation unit 98.
The integrated API management unit 80 is an example of an acquisition means, acquires processing target data such as image data and audio data and attribute data from the integrated API calling unit 42 of the mobile terminal 20, and accepts a request for an information processing service for the processing target data. In this case, the integrated API management section 80 transmits the type and attribute data of the service to be used to the API selection section 90, inquires of which external system is selected, and receives the response from the API selection section 90. Then, the integrated API management section 80 issues an instruction to the individual API calling section 82 to use the information processing service of the selected external system, and transmits the processing object data. The integrated API management unit 80 is also an example of a transmission means, and transmits the execution result of the information processing service to the mobile terminal 20.
The individual API calling unit 82 is an example of a request unit, and executes an information processing service to an external system request in accordance with an instruction from the integrated API managing unit 80. The individual API calling unit 82 is provided with an external system a calling unit 84. The external system a calling unit 84 calls an API provided by the external system a 130, and transmits processing target data and data required for requesting an information processing service, and executes the information processing service to obtain an execution result. Similarly, the individual API calling unit 82 is provided with an external system B calling unit 86 that calls the API of the external system B140, and an external system C calling unit 88 that calls the API of the external system C150. If there is an external system available, the individual API calling unit 82 is configured to construct an API calling unit related to the external system.
The API selecting unit 90 is an example of a selecting means, and performs selection as to which external system the information processing service is to be used. The API selecting section 90 is provided with an attribute identifying section 92. The attribute identifying unit 92 identifies attribute information from the attribute data. Then, the external system to be used is selected under the attribute by referring to the selection rule held by the selection rule holding unit 94.
The selection rule holding unit 94 holds a selection rule which is a rule for selecting an external system. The selection rules are determined for each information processing service that is desired to be utilized and for each appropriate attribute.
The selection rule setting/updating unit 96 is an example of updating means, and performs initial setting and subsequent updating of the selection rule. The selection rule setting/updating unit 96 performs updating of the selection rule concerning the information processing service and the attribute thereof by actually using all available external systems for each information processing service with an appropriate attribute and evaluating the result. Specifically, the selection rule setting/updating unit 96 causes the individual API calling unit 82 to request information processing services for all the set external systems, and causes the result determination/accumulation unit 98 to evaluate the obtained execution result, thereby updating the selection rule.
The result determination/accumulation unit 98 is an example of the determination means and the update means, and obtains the execution result of the information processing service from the individual API calling unit 82, and evaluates the result. The result determination/accumulation unit 98 includes an accuracy determination unit 100, a majority vote determination unit 102, and a precision determination unit 104 as a configuration for performing evaluation.
When the external system performs the information processing service, the accuracy determination unit 100 compares the execution results using the accuracy data output together with the execution results. Here, accuracy is information provided from an external system as information indicating the accuracy of the execution result of the information processing service or the like. Accuracy is expressed, for example, in terms of 0 as the lowest point and 100 as the full fraction. However, the calculation algorithm of accuracy generally differs depending on the external system. Therefore, in order to be able to compare the accuracy of different external systems, adjustments are made as necessary. For example, the conversion formula can be set by the manager from a theoretical viewpoint and adjusted. For example, the maintenance person 300 may set a conversion type to adjust the execution result based on the result of actually evaluating the execution result. The determination result of the accuracy determination unit 100 is used to determine the execution result transmitted from the integrated API management unit 80 to the mobile terminal 20 in the assistance of the normal maintenance management job. In addition, the determination result of the accuracy determination section 100 can also be used as update information of the selection rule in the selection rule setting/updating section 96.
When information processing services of 3 or more external systems are used, the majority vote determination unit 102 determines an execution result with high validity by a majority vote method. That is, when the information processing services of a plurality of external systems obtain the same execution result, it is determined that the validity of the execution result is high. When the majority vote results in the distributed votes (i.e., when there are a plurality of 1 st bits), the judgment may be performed by another means such as the judgment result issued to the accuracy judgment unit 100. The determination result of the majority vote determination unit 102 is used to determine the execution result transmitted from the unified API management unit 80 to the mobile terminal 20 in the assistance of the normal maintenance management job. The determination result of the majority vote determination unit 102 can also be used as update information of the selection rule in the selection rule setting/updating unit 96.
The accuracy determination unit 104 actually evaluates the accuracy of the execution result by the maintenance person 300, and determines an accurate execution result based on the result. The determination by the accuracy determination unit 104 is used, for example, as update information of the selection rule in the selection rule setting/updating unit 96.
Fig. 6 is a diagram schematically showing the functions of the external system a 130. The external system a 130 includes an API 132, an OCR service 134, an image recognition service 136, and a sound recognition service 138.
The API 132 is an interface provided by the external system a 130 to utilize the information processing service of the external system a 130. The user using the external system a 130 can obtain the execution result of the information processing service by calling the API and transmitting the prescribed data.
The OCR service 134 is an information processing service that generates character codes from characters (including numerals, symbols, and the like) included in image data. In the maintenance management work support system 10, the OCR service 134 is used for character encoding of characters described in, for example, the sign 312 in the building equipment.
The image recognition service 136 is an information processing service that recognizes a person, an object, or the like included in the image data. In the image recognition service 136, pattern matching may also be performed in which the recognized person or object is associated with a specific person or object. In the maintenance management job support system 10, the image recognition service 136 is used, for example, to extract components from image data of components of building equipment and determine the manufacturer, model, and the like of the extracted components.
The voice recognition service 138 is an information processing service that generates character codes from the voice data. In the voice recognition service 138, semantic analysis of character codes and the like may also be performed. In the maintenance management job support system 10, the voice recognition service 138 is used, for example, for the maintenance person 300 to dictate a record of the maintenance management job.
In addition to the translation service for performing the inter-language translation, the dictionary search service for investigating the meaning of the term of art, and other various information processing services can be provided in the external system a 130. The external systems B140 and C150 also provide various information processing services including information processing services of the same type as the external system a 130, such as OCR service, image recognition service, voice recognition service, translation service, dictionary search service, and the like. Here, the same kind of information processing service refers to a service capable of performing substantially the same kind of information processing.
The external system a 130, the external system B140, and the external system C150 are each constructed using 1 or more computers connected to the internet 120. Also, the information processing services provided by these systems are structured to be utilized by various users in the form of so-called cloud computing. The maintenance management job support system 10 is configured to use these external systems for support of maintenance management jobs.
(2) Action of the System
With reference to fig. 7 to 12, an operation and an operation example of the system according to the embodiment will be described.
Fig. 7 is a timing chart for explaining the operation of the maintenance management job support system 10 during the support of a normal maintenance management job. The maintenance person 300 operates the mobile terminal 20 to start an application for maintenance management work. Then, the maintenance person 300 photographs the sign 312 of the building equipment that is the maintenance management work object using the camera 32 of the portable terminal 20 (S10).
Fig. 8 schematically shows an example of the tag 312. The label 312 includes information including a product name "good", a model name "ABC-DEFGH", a manufacturing number "12JKLMN", and a manufacturer name "company X". The product name is a name of a building device, and for example, when the building device is an outdoor unit of an air conditioning system, a name such as "air conditioning outdoor unit" or a name of a registered trademark is given. The model name is a character string that uniquely identifies the same specification product among the products of the manufacturer. In the example of fig. 8, it is assumed that "ABC" in the model name is a character string indicating that the air conditioner is an outdoor unit, and "DEFGH" is a character string indicating a specific specification in the air conditioner. The manufacturing number is a character string that uniquely identifies each product having each form.
Fig. 9 is a diagram schematically showing the mobile terminal 20 in a state where the camera 32 captures the tag 312. The name of an application named "device information management tool" is displayed on the display unit 50 of the mobile terminal 20. In fig. 9, it is assumed that the application is set as a screen for performing OCR processing. The display unit 50 displays 160 based on the image data generated by the camera 32 under the description of the "captured image". Display 160 contains a captured signage 312. In the application, the image data is regarded as processing target data to be OCR processed, and a request for OCR processing is transmitted to the unified API calling unit 42 (S12).
The unified API calling unit 42 requests the input of attribute information in order to perform OCR processing. In the example shown in fig. 9, an input field 162 of an attribute is provided under the description of "input attribute". The input field 162 is provided with a triangle button 164, and when the triangle button 164 is pressed, candidates for input are displayed. In the example shown in fig. 9, "X company air conditioner (outdoor)" is input as an attribute (S14). As described above, the attribute may be input by receiving a beacon, for example.
In the example shown in fig. 9, a send button 166 and a return button 168 are also displayed under the description of "send to auxiliary server". When the maintenance person 300 presses the send button 166, the integration API calling unit 42 adds image data and attribute data to request the assist server 60 for an OCR processing request (S16).
In the assist server 60, the unified API management unit 80 acquires the OCR processing request, the image data, and the attribute data. In this case, the integrated API management section 80 transmits attribute data to the API selection section 90, and requests selection of an external system to be used and a corresponding API (S18). In the API selecting section 90, the attribute identifying section 92 identifies a desired attribute from the attribute data. Then, the API selecting unit 90 refers to the selection rule held by the selection rule holding unit 94, and selects an external system to which a request for OCR processing should be made, for the identified attribute (S20). The information of the selected external system is sent from the API selecting section 90 to the integrated API managing section 80 (S22).
Fig. 10 is a diagram showing an example of the selection rule held by the selection rule holding unit 94. The selection rule is set for each type of information processing service. Fig. 10 shows selection rules related to OCR services. In the example of fig. 10, in the selection rule, a manufacturer of the device, a type of the device, and a location of the device are set as attributes. The manufacturer of the apparatus is set with company X (corporation X) and other companies (other companies). As the type of the equipment, electric, air-conditioning, and the like are set. In addition, an indoor space and an outdoor space are set as the locations of the devices. In the example shown in fig. 9, "X company air conditioner (outdoor)" is input as an attribute, and matches the attribute of the column surrounded by the thick frame 170.
The manufacturer as the device is classified into X company and other companies because it is characteristic that the sign character of X company is assumed to be different from that of other companies. In OCR processing pertaining to the X company and OCR processing pertaining to other companies, a difference is seen due to a tendency of accuracy, and thus classification is performed.
Similarly, the electrical equipment, the air conditioner, and the like are provided as the types of equipment, and the characteristics are provided in the signs of the electrical equipment and the air conditioner, respectively, and there is a tendency that the difference in accuracy is observed in OCR processing. In addition, the degree of degradation of the sign and the light are different between indoor and outdoor, and thus the values of the attributes are distinguished.
The selection rule is also provided with a column of external systems, and a plurality of external systems typified by external system a 130, external system B140, and external system C150 are set. When looking at the inside of the thick frame 170, a value of "request 96%" is input to the external system a 130. This means that the accuracy of the OCR service of the external system a 130 is about 96% under the condition of this attribute (here, if it is assumed that it is higher than 95%, it is entrusted to be set to entrusted with the OCR service). The value of "no request 93%" is input to the external system B140. In the external system B140, the accuracy is set to a value as low as about 93% under the condition of the attribute, and thus, OCR service is not requested. In addition, a value of "request 97%" is set for the external system C150. That is, in the external system C150, the accuracy is about 97%, and thus, it is set to request OCR service. In the selection rule, similarly, a value of whether or not to request each external system is set under the condition of other attributes.
When referring to the selection rule shown in fig. 10, the API selecting unit 90 responds to the selection of the external system a 130 and the external system C150 (and other external systems not shown) from the integrated API managing unit 80. The integrated API management unit 80 instructs the individual API calling unit 82 to call the selected API of each external system and requests OCR processing (S24). Upon instruction, the image data to be processed is also transmitted from the integrated API managing section 80 to the individual API calling section 82.
The individual API calling unit 82 calls the selected API of each external system and requests OCR processing (S26). At the time of requesting OCR processing, image data and special data (which will be referred to as API parameters) of each API request are transmitted. The API parameter stores, for example, data unique to each API such as a registered user name of an external system and a type of an electronic file storing an execution result.
In the external system a 130 and the external system C150, OCR processing is performed on the image data with reference to the information input to the API, respectively. In the OCR processing, a character code as an execution result and data of accuracy of the execution result are output. The external system a 130 and the external system 150 store the execution result and the accuracy data in a predetermined electronic file, respectively, and transmit the same to the assist server 60 through the API (S28).
In the assist server 60, the individual API calling unit 82 receives data of the execution result and accuracy of each API. Then, the individual API calling unit 82 sends the data of each execution result and accuracy to the result determination/accumulation unit 98, and makes a determination request as to which execution result is to be used (S30).
The accuracy determination unit 100 of the result determination/accumulation unit 98 performs determination based on accuracy. Fig. 11 shows an example of the accuracy obtained together with the execution result. In the illustrated example, the accuracy of external system a 130 is 97% and the accuracy of external system C150 is 96%. Accordingly, it is determined that the OCR service of the external system a 130 has the highest accuracy, and the execution result of the OCR service is accumulated (S32).
The result determination/accumulation unit 98 transmits the execution result of OCR of the accumulated external system 130 to the integrated API management unit 80 (S34). Then, the integrated API management section 80 transmits the OCR result to the portable terminal (S36).
In the mobile terminal 20, the unified API calling unit 42 receives the OCR result. The unified API calling unit 42 analyzes the OCR result and displays a predetermined item on the display unit 50.
Fig. 12 is a diagram showing a case where the OCR result is displayed on the application screen of the display unit 50. The display unit 50 displays 180 the results of the model name "ABC-DEFGH" and the manufacturing number "12JKLMN" under the description of the "OCR result". In the example shown in fig. 12, the model name and the manufacturing number of the OCR result match the model name and the manufacturing number described in the label 312 shown in fig. 8. Therefore, the maintenance person 300 does not need to perform correction.
In a state where the communication state is not obstructed, the time required from the execution of the OCR processing request in step S16 to the display of the execution result in step S38 is small (for example, 1 second or less), and the model name and the manufacturing number can be obtained very quickly as compared with the case where the maintenance person 300 inputs the model name and the manufacturing number by himself.
However, a situation may occur in which the OCR result is different from the description of the sign 312. For example, errors in the numbers "0" and the letter "O", errors in the numbers "1" and the lower case letter "l" often occur. Accordingly, the display unit 50 displays a notice such as "please correct if incorrect", and conveys that the screen can be touched to change the value. When a value is input by touching the screen, the execution result correctness input unit 52 operates to rewrite the execution result.
Alternatively, when the beacon is received by the beacon receiving unit 44, the OCR result may be compared with the received content of the beacon. That is, the attribute correctness determination unit 48 compares the two, and if there is a mismatch, the display unit 50 displays the result. In the case of mismatch based on OCR, the maintenance person 300 may touch the screen to directly input a value or may perform an operation of replacing the value with a beacon signal. When there is an error in the beacon signal, a process of correcting the beacon signal is performed separately.
The display unit 50 also records "register to the auxiliary server? A registration button 182 and a return button 184 are displayed below. In the case where the registration button 182 is pressed, the OCR result is definitively registered in the assist server 60. Although not shown, the result of the maintenance management operation of the building equipment is input to the next screen in the mobile terminal 20. In the maintenance management work using the mobile terminal 20, the application of the mobile terminal 20 communicates with the assist server 60 appropriately, and records the work content. The auxiliary server 60 can perform various services such as creation of a service report and confirmation of a failure based on the record.
In addition, in the assist server 60, the OCR result can also be evaluated using the model name and the manufacturing number registered by the maintenance person 300 pressing the registration button 182. Specifically, the OCR result is evaluated in the accuracy determination unit 104 of the result determination/accumulation unit 98. The selection rule may be updated based on the evaluation result.
In the above description, an example is shown in which the execution result determined to be the highest in accuracy is transmitted to the mobile terminal 20 in the accuracy determining unit 100 of the assist server 60. Instead of this, the execution result to be transmitted to the mobile terminal 20 may be determined by the majority voting method by the majority voting determination unit 102. The majority voting scheme can be generally employed when the derived information processing service is implemented in 3 or more external systems.
Next, a process of updating the selection rule will be described. In an external system, an algorithm of an information processing service may be changed by being transmitted to a user, or an algorithm of an information processing service may be changed by not being transmitted to a user. Accordingly, the accuracy of the execution result of the information processing service changes. Accordingly, the assist server 60 updates the selection rule periodically or at the timing when the algorithm is changed.
When updating the selection rule, the selection rule setting/updating unit 96 changes the flow of processing in the assist server 60. Specifically, the API selecting section 90 selects all available external systems instead of selecting a part of the external systems according to the selection rule. Then, the result determination/accumulation unit 98 evaluates the execution results of all external systems, and updates the selection rule based on the evaluation results. Updating of the selection rule is performed per attribute.
In addition, if the selection rule is updated based on the 1-shot result of the camera 32, it is greatly affected by errors or the like at the time of shooting. Therefore, it is considered preferable to change the selection rule based on the execution result of a plurality of times (for example, 10 times or more or 30 times or more). As described above, the updating of the selection rule may be performed based on the results of the majority vote determination unit 102 or the accuracy determination unit 104, instead of the results of the accuracy determination unit 100.
In the above description, the selection rule shown in fig. 10 is taken as an example, and a method of selecting an information processing service of an external system is described. However, the selection rule may be other than the one shown in fig. 10. The selection rule is set as a countermeasure against a case where the result of the information processing service differs according to the attribute. Therefore, attributes that do not significantly differ are excluded from the selection rule. For example, in the selection rule shown in fig. 10, it is considered that only 1 or 2 are reserved from the manufacturer of the device, the kind of the device, and the location of the device, and other attributes are excluded from the selection rule. In addition, when a large difference occurs due to other properties not described in the selection rule shown in fig. 10, the selection rule may be re-incorporated. As an example, consider that information of a work time is included as an attribute, and a selection rule is made different between a daytime period and a nighttime period. During the day and night, in particular, the illuminance outside the room varies, and thus, the accuracy of the OCR process may see a difference.
The above description has been made taking OCR service as an example. However, as well, the execution result of the image recognition service or the voice recognition service depends on, for example, the brightness of the surroundings, the noise of the surroundings, and the like. Therefore, it is effective to set the selection rule according to the attribute.
Description of the reference numerals
10: a maintenance management operation auxiliary system; 20: a portable terminal; 22: a bus; 24: a processor; 26: a memory; 28: a touch panel; 30: a communication circuit; 32: a camera; 34: a microphone; 40: an attribute information input unit; 42: a unified API calling unit; 44: a beacon receiving unit; 46: an attribute acquisition unit; 48: an attribute correctness determination unit; 50: a display unit; 52: an input unit; 60: an auxiliary server; 62: a bus; 64: a processor; 66: a memory; 68: a touch panel; 70: a communication circuit; 80: a unified API management unit; 82: an individual API calling part; 84: an external system A calling part; 86: an external system B calling unit; 88: an external system C calling unit; 90: an API selection unit; 92: an attribute identification unit; 94: a selection rule holding unit; 96: a selection rule setting/updating section; 98: a result determination/accumulation unit; 100: an accuracy determination unit; 102: a majority vote determination unit; 104: a precision determination unit; 110: a central monitoring device; 120: the Internet; 130: an external system A;134: an OCR service; 136: an image recognition service; 138: a voice recognition service; 140: an external system B;150: an external system C;160: displaying; 162: an input field; 164: a triangular button; 166: a send button; 168: a return button; 170: a thick frame; 180: displaying; 182: a registration button; 184: a return button; 300: maintenance personnel; 310: an outdoor unit; 312: and (3) a label.

Claims (7)

1. A maintenance management work support device is characterized by comprising:
an acquisition unit that acquires, from a portable terminal used in a maintenance management job of a building device, attribute data indicating an attribute related to the building device or the maintenance management job, the attribute related to the building device being information indicating a feature of the building device, and processing target data used in the maintenance management job, the attribute related to the maintenance management job being information indicating a feature of the maintenance management job;
a selection unit that selects an information processing service that is a request target of execution from among a plurality of information processing services of the same kind provided by a plurality of external systems, in accordance with a selection rule set for the attribute;
a request unit that calls an API corresponding to the selected information processing service, transmits the processing object data, and requests execution of the information processing service;
a receiving unit that receives an execution result of the information processing service through the API; and
a transmitting unit that transmits the received execution result of the information processing service to the portable terminal,
The maintenance management job support device has an updating unit that selects a plurality of information processing services of the same kind provided by the plurality of external systems, requests execution by the requesting unit and receives an execution result by the receiving unit, compares the received execution results of the respective information processing services, and updates the selection rule set for the attribute.
2. The maintenance management work support device according to claim 1, wherein,
the receiving unit obtains the execution result together with data of accuracy of the execution result,
the updating unit updates the selection rule so that an information processing service that has obtained an execution result with high accuracy is an information processing service that is a request object related to the attribute.
3. The maintenance management work support device according to claim 1, wherein,
the updating means updates the selection rule so that the information processing service for which the execution result having high accuracy is obtained is the information processing service of the request object related to the attribute, by transmitting the execution result of each information processing service to the mobile terminal by the transmitting means and acquiring data of the accuracy of the execution result of each information processing service from the mobile terminal.
4. A maintenance management work support device is characterized by comprising:
an acquisition unit that acquires, from a portable terminal used in a maintenance management job of a building device, attribute data indicating an attribute related to the building device or the maintenance management job, the attribute related to the building device being information indicating a feature of the building device, and processing target data used in the maintenance management job, the attribute related to the maintenance management job being information indicating a feature of the maintenance management job;
a selection unit that selects 2 or more information processing services as execution request targets from among a plurality of information processing services of the same type provided by a plurality of external systems, in accordance with a selection rule set for the attribute;
a request unit that calls an API corresponding to the selected 2 or more information processing services, and transmits the processing target data to request execution of the information processing services;
a receiving unit that receives execution results of the selected 2 or more information processing services through the API;
a determination unit that compares execution results of the 2 or more information processing services received by the reception unit, and determines execution results of 1 information processing service to be transmitted; and
And a transmitting unit that transmits the execution result of the 1 information processing services determined by the determining unit to the portable terminal.
5. The maintenance management work support device according to claim 4, wherein,
the receiving unit obtains the execution result together with data of accuracy of the execution result,
the determination unit determines an information processing service that has obtained an execution result with high accuracy as the transmission target.
6. A maintenance management operation portable terminal, characterized in that the maintenance management operation portable terminal comprises:
a data acquisition unit that acquires processing target data used for maintenance management work of building equipment;
an attribute acquisition unit that acquires attribute data indicating an attribute related to the building equipment or the maintenance management job, the attribute related to the building equipment being information indicating a feature of the building equipment, the attribute related to the maintenance management job being information indicating a feature of the maintenance management job;
a request unit that transmits the processing object data and the attribute data, requesting an information processing service for the processing object data;
A result acquisition unit that acquires execution results of information processing services selected based on the attribute among a plurality of identical information processing services provided by a plurality of external systems; and
a receiving unit that receives a beacon transmitted from the building device,
the attribute acquisition unit acquires the attribute data from the received beacon.
7. The maintenance management work portable terminal according to claim 6, wherein,
the processing object data is image data obtained by photographing a display of the building equipment,
the information processing service is an OCR service that generates character codes that determine the building devices as the execution results from the image data,
the beacon is a signal containing data that determines the building device,
the attribute data acquired by the attribute acquisition unit includes data specifying the building equipment,
the maintenance management work portable terminal includes a determination unit that compares the character code acquired by the result acquisition unit with the data for identifying the building equipment acquired by the attribute acquisition unit, and determines whether the display of the building equipment or the beacon is not matched.
CN202080100860.6A 2020-05-15 2020-05-15 Maintenance management operation support device and maintenance management operation portable terminal Active CN115552446B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/019440 WO2021229795A1 (en) 2020-05-15 2020-05-15 Maintenance management work support device and maintenance management work mobile terminal

Publications (2)

Publication Number Publication Date
CN115552446A CN115552446A (en) 2022-12-30
CN115552446B true CN115552446B (en) 2023-10-31

Family

ID=78525591

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080100860.6A Active CN115552446B (en) 2020-05-15 2020-05-15 Maintenance management operation support device and maintenance management operation portable terminal

Country Status (3)

Country Link
JP (1) JP7162778B2 (en)
CN (1) CN115552446B (en)
WO (1) WO2021229795A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7486687B1 (en) 2023-07-11 2024-05-17 三菱電機株式会社 Specification confirmation device, specification confirmation system, and specification confirmation method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10187812A (en) * 1996-12-26 1998-07-21 Hitachi Building Syst Co Ltd Maintenance work managing system for building
JP2005228025A (en) * 2004-02-13 2005-08-25 Marusei Co Ltd Maintenance management system for building
JP2008293354A (en) * 2007-05-25 2008-12-04 Canon Inc Document image recognition system
CN102298696A (en) * 2010-06-28 2011-12-28 方正国际软件(北京)有限公司 Character recognition method and system
CN105093938A (en) * 2015-03-13 2015-11-25 霍尼韦尔环境自控产品(天津)有限公司 Building control system design and maintenance device and method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2196953B1 (en) * 2008-12-12 2020-04-08 Siemens Aktiengesellschaft Method, control program and system for identifying a container in a container crane assembly
JP5476752B2 (en) * 2009-03-13 2014-04-23 株式会社リコー Information processing apparatus, information processing method, and program
JP5821417B2 (en) * 2011-08-30 2015-11-24 コニカミノルタ株式会社 Service evaluation system, image forming apparatus, and program
JP6070706B2 (en) * 2012-08-06 2017-02-01 富士通株式会社 Cloud service selection device, cloud service selection system, cloud service selection method, and cloud service selection program
JP2015064857A (en) * 2013-09-02 2015-04-09 株式会社リコー Character recognition system, character recognition control method, and character recognition control program
JP6606890B2 (en) * 2015-07-08 2019-11-20 富士ゼロックス株式会社 Information processing apparatus and information processing program
JP6763245B2 (en) * 2016-09-13 2020-09-30 富士ゼロックス株式会社 Information processing equipment and information processing programs
CN110415796A (en) * 2018-04-27 2019-11-05 通用电气公司 For the assets management method of Medical Devices, asset management platform, computer readable storage medium and mobile terminal
CN110647784A (en) * 2018-06-27 2020-01-03 中国移动通信集团浙江有限公司 Equipment asset management method and device based on deep learning

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10187812A (en) * 1996-12-26 1998-07-21 Hitachi Building Syst Co Ltd Maintenance work managing system for building
JP2005228025A (en) * 2004-02-13 2005-08-25 Marusei Co Ltd Maintenance management system for building
JP2008293354A (en) * 2007-05-25 2008-12-04 Canon Inc Document image recognition system
CN102298696A (en) * 2010-06-28 2011-12-28 方正国际软件(北京)有限公司 Character recognition method and system
CN105093938A (en) * 2015-03-13 2015-11-25 霍尼韦尔环境自控产品(天津)有限公司 Building control system design and maintenance device and method

Also Published As

Publication number Publication date
WO2021229795A1 (en) 2021-11-18
JP7162778B2 (en) 2022-10-28
CN115552446A (en) 2022-12-30
JPWO2021229795A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
JP5416322B2 (en) Work management system, work management terminal, program, and work management method
US20160342701A1 (en) Apparatus and server for constructing street light management database, and controlling method therefor
CN112020710B (en) Information providing system and information providing method
CN112313641B (en) Information providing system and information providing method
WO2008051662A1 (en) Location based large format document display
CN111078556A (en) Application testing method and device
CN115552446B (en) Maintenance management operation support device and maintenance management operation portable terminal
JP2020021287A (en) System and method for providing information
CN112487312A (en) Method and device for associating interest points and method and device for determining states of interest points
CN112507249A (en) Method and device for generating interest points, electronic equipment and storage medium
CN113468541B (en) Identification method, identification device, electronic equipment and storage medium
CN118020321A (en) System and method for enabling indoor positioning
CN114219420A (en) Processing method and device for handling guaranteed housing based on AI and RPA
KR102392897B1 (en) The centralized control all-in-one hybrid smart intergrated bus informaition system
KR100847002B1 (en) Mobile terminal for managing outdoor signboard information, search system and search method of using the terminal
CN110942124A (en) Intelligent management method and device for electric power safety tools
US20210374104A1 (en) Electronic apparatus, log collection system, and control method for electronic apparatus
EP3261032A1 (en) Presence monitoring method and system
CN115357630B (en) Information detection method, apparatus, device, computer readable medium and program product
CN114118285B (en) Building data matching method and device and electronic equipment
CN113313427B (en) Data demand analysis method, system and storage medium
CN115455128A (en) Electronic fence remaining white processing method and device
EP4148604A1 (en) Information processing apparatus, information processing method, and program
US20240203120A1 (en) Generating mapping information based on image locations
CN118365304A (en) Resource management method of conference room and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant