CN115552446A - Maintenance work support device and maintenance work portable terminal - Google Patents

Maintenance work support device and maintenance work portable terminal Download PDF

Info

Publication number
CN115552446A
CN115552446A CN202080100860.6A CN202080100860A CN115552446A CN 115552446 A CN115552446 A CN 115552446A CN 202080100860 A CN202080100860 A CN 202080100860A CN 115552446 A CN115552446 A CN 115552446A
Authority
CN
China
Prior art keywords
information processing
unit
attribute
data
maintenance management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202080100860.6A
Other languages
Chinese (zh)
Other versions
CN115552446B (en
Inventor
妻鹿利宏
川崎仁
齐藤启太
冈里笃
大谷晋一郎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Building Solutions Corp
Original Assignee
Mitsubishi Electric Building Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Building Solutions Corp filed Critical Mitsubishi Electric Building Solutions Corp
Publication of CN115552446A publication Critical patent/CN115552446A/en
Application granted granted Critical
Publication of CN115552446B publication Critical patent/CN115552446B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services

Landscapes

  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Development Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Tourism & Hospitality (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Game Theory and Decision Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

An assist server (60) as a maintenance management work assist device acquires attribute data indicating attributes relating to building equipment or maintenance management work and processing target data used for the maintenance management work from a portable terminal (20) used for the maintenance management work for the building equipment (S16). Then, an information processing service to be executed is selected from a plurality of information processing services of the same type provided by a plurality of external systems (130, 140, 150) according to a selection rule set for the attribute (S20). Next, the API corresponding to the selected information processing service is called, the processing target data is transmitted, and execution of the information processing service is requested (S26). Further, the execution result of the information processing service is received through the API (S28). The received execution result of the information processing service is transmitted to the portable terminal (S36).

Description

Maintenance work support device and maintenance work portable terminal
Technical Field
The present invention relates to a maintenance work support device and a maintenance work portable terminal used for maintenance work of building equipment.
Background
In maintenance work for building equipment, information processing services such as Optical Character Recognition (OCR) provided by an external system are sometimes used. External systems are typically built to be utilized through an API (Application Programming Interface) provided by the external system.
In many cases, similar information processing services are provided by a plurality of external systems. Moreover, the results obtained by the respective information processing services differ for each external system. In addition, in the external system, the algorithm of the program in charge of the information processing service may be changed without notifying the user. Therefore, even in the case of using the same information processing service of the same external system, a situation in which the result differs depending on the timing can be seen. Therefore, if the optimal information processing service can be selected from a plurality of external systems, it is considered that the efficiency of the maintenance management work is improved.
Patent document 1 describes the following: an OCR server meeting conditions such as an evaluation value and a processing speed is selected from a plurality of OCR servers connected to a network, and a document image is transmitted.
Documents of the prior art
Patent document
Patent document 1: japanese patent laid-open No. 2008-293354
Disclosure of Invention
Problems to be solved by the invention
The maintenance and management work of building equipment involves many aspects. For example, even for the same device, the content of the maintenance management work may vary depending on the manufacturer, model, and the like. In addition, in the maintenance management work, there are various work environments such as an implementation place and an implementation time. Therefore, it is difficult to determine an appropriate information processing service without difference from the same information processing services of a plurality of external systems. The technique described in patent document 1 is merely a technique for selecting an OCR server for a document image obtained in a somewhat homogeneous environment, and is difficult to apply to maintenance management work for building equipment.
The purpose of the present invention is to enable the information processing service of an external system used for maintenance management work of building equipment to be appropriately selected.
Means for solving the problems
The maintenance work support device of the present invention includes: an acquisition unit that acquires attribute data indicating an attribute related to a building device or a maintenance management operation from a portable terminal used for the maintenance management operation of the building device, and processing target data used for the maintenance management operation; a selection unit that selects an information processing service to be executed as a request target from among a plurality of information processing services of the same type provided by a plurality of external systems, in accordance with a selection rule set for the attribute; a request unit which calls an API corresponding to the selected information processing service, transmits the processing object data, and requests execution of the information processing service; a receiving unit that receives an execution result of an information processing service through the API; and a transmission unit that transmits the received execution result of the information processing service to the portable terminal.
In one aspect of the present invention, the maintenance management work support device includes an updating unit that selects a plurality of information processing services of the same type provided by the plurality of external systems, requests execution by the requesting unit, receives execution results by the receiving unit, compares the received execution results of the respective information processing services, and updates the selection rule set for the attribute.
In one aspect of the present invention, the receiving unit obtains data of accuracy of the execution result together with the execution result, and the updating unit updates the selection rule so that the information processing service for which the execution result with high accuracy is obtained is the information processing service for which the attribute-related request is made.
In one aspect of the present invention, the updating means transmits the execution result of each information processing service to the mobile terminal via the transmitting means, and acquires data on the accuracy of the execution result of each information processing service from the mobile terminal, thereby updating the selection rule so that the information processing service for which the execution result with high accuracy is obtained is the information processing service for which the request on the attribute is directed.
In one aspect of the present invention, the selection means selects 2 or more of the same type of information processing service, the request means requests execution of the selected 2 or more of the information processing services, the reception means receives the execution result of the selected 2 or more of the information processing services, the maintenance management work support device further includes determination means for comparing the execution results of the 2 or more of the information processing services received by the reception means and determining the execution result of the 1 of the information processing services to be transmitted, and the transmission means transmits the 1 of the execution results determined by the determination means to the mobile terminal.
In one aspect of the present invention, the receiving means acquires data on accuracy of the execution result together with the execution result, and the determining means determines the information processing service for which the execution result with high accuracy is acquired as the transmission target.
In one aspect of the present invention, the attribute data includes data indicating a manufacturer of the building device, and the selection rule is set according to the manufacturer.
In one aspect of the present invention, the attribute data is data indicating a type of the building device, and the selection rule is set according to the type of the building device.
In one aspect of the present invention, the attribute data is data indicating an installation location of the building device, and the selection rule is set according to whether the installation location of the building device is outdoor or indoor.
In one aspect of the present invention, the attribute data is data indicating a working time of the maintenance management work, and the selection rule is set according to whether the working time of the maintenance management work is day time or night time.
In one embodiment of the present invention, the processing target data is image data, and the information processing service is an OCR service that generates a character code from the image data.
The maintenance management work portable terminal of the present invention includes: a data acquisition unit that acquires processing target data used for maintenance management work for the building equipment; an attribute acquisition unit that acquires attribute data indicating an attribute relating to the building equipment or the maintenance management work; a requesting unit that transmits the processing target data and the attribute data and requests an information processing service for the processing target data; and a result acquisition unit that acquires an execution result of the information processing service selected based on the attribute, from among a plurality of heterogeneous information processing services provided by a plurality of external systems.
In one aspect of the present invention, the maintenance work mobile terminal includes a receiving unit that receives a beacon transmitted from the building equipment, and the attribute acquiring unit acquires the attribute data from the received beacon.
In one aspect of the present invention, the processing target data is image data obtained by imaging a display specifying the building device, the information processing service is an OCR service for generating a character code specifying the building device as the execution result from the image data, the beacon is a signal including data specifying the building device, the attribute data acquired by the attribute acquisition unit includes data specifying the building device, and the maintenance management task portable terminal includes a determination unit for comparing the character code acquired by the result acquisition unit and the data specifying the building device acquired by the attribute acquisition unit and determining that the display specifying the building device or the beacon is not matched.
Effects of the invention
According to the present invention, it is possible to obtain a highly accurate execution result by appropriately selecting an information processing service of an external system used for a maintenance management operation of a building device in accordance with the building device or the maintenance management operation.
Drawings
Fig. 1 is a diagram of the overall configuration of a maintenance work assistance system.
Fig. 2 is a block diagram showing a hardware configuration of the mobile terminal.
Fig. 3 is a block diagram showing a functional configuration of the mobile terminal.
Fig. 4 is a block diagram showing a hardware configuration of the assist server.
Fig. 5 is a block diagram showing a functional configuration of the assist server.
Fig. 6 is a block diagram showing a functional configuration of an external system.
Fig. 7 is a sequence diagram of the maintenance management work assistance system.
Fig. 8 is a diagram schematically showing an example of the signboard.
Fig. 9 is a diagram showing an example of a transmission screen of image data in the mobile terminal.
Fig. 10 is a diagram showing an example of the selection rule.
Fig. 11 is a diagram showing an example of accuracy in the execution result of OCR.
Fig. 12 is a diagram showing an example of display of the OCR execution result in the mobile terminal.
Detailed Description
(1) Structure of system
An example of the system configuration of the embodiment will be described with reference to fig. 1 to 6.
Fig. 1 is a diagram showing an overview of the overall configuration of a maintenance management work support system 10 according to an embodiment. The maintenance work support system 10 is a system used by a maintenance worker 300 who performs maintenance management of building equipment in maintenance management work. Here, the building device is a device installed in a building and installed to use the building. In fig. 1, an outdoor unit 310 of an air conditioning system is illustrated as an example of a building device. In many cases, an air conditioning system including an outdoor unit 310, an indoor unit, and a refrigerant circuit is installed in a building facility, and a maintenance person 300 performs maintenance and management periodically. In addition to an air conditioning system, various devices such as electrical devices, lighting devices, fire protection devices, elevators, escalators, water supply lines, sewers, and entrance and exit security systems are installed in building equipment.
The maintenance staff 300 is an employee of a maintenance management company that performs maintenance management of the building equipment. The maintenance worker 300 performs maintenance management work according to a manual or the like. The maintenance work includes a spot inspection work, a replacement/repair work for a defective portion, and the like. In the maintenance work, work according to the type, form, and the like of the building equipment is performed. For example, in the outdoor unit 310, the sign 312 is attached from the manufacturer, and the maintenance worker 300 performs maintenance management work with reference to the sign 312 as appropriate.
The maintenance work support system 10 includes a mobile terminal 20, a support server 60, a central monitoring device 110, the internet 120, an external system a 130, an external system B140, and an external system C150.
The mobile terminal 20 is an example of a maintenance work mobile terminal, and is a computer carried by a maintenance worker 300. The support server 60 is a computer configured to be able to communicate with the mobile terminal 20 and supports the maintenance management work of the maintenance worker 300. The central monitoring device 110 is a computer installed in a central monitoring room of a building installed in a building facility to control the building facility. The internet 120 is a communication network that communicatively connects the support server 60 to the external system a 130, the external system B140, the external system C150, and the like. The external system a 130, the external system B140, and the external system C150 are computer systems operated by other enterprises, and provide a plurality of information processing services.
The mobile terminal 20 will be described in detail with reference to fig. 2 and 3. Fig. 2 is a diagram schematically showing the hardware configuration of the mobile terminal 20. Fig. 3 is a diagram schematically showing functions built in the mobile terminal 20.
The portable terminal 20 is constructed using, for example, a smartphone, a tablet computer, a notebook PC (personal computer), or the like. As shown in fig. 2, the portable terminal 20 includes a bus 22, a processor 24 connected to the bus 22, a memory 26, a touch panel 28, a communication circuit 30, a camera 32, and a microphone 34. The processor 24 is configured by an arithmetic Processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). In fig. 2, these 1 or more arithmetic processing units are symbolically referred to as a processor 24.
The memory 26 is a device that stores software and data. As the memory 26, 1 or more semiconductor memories, magnetic disks, or the like are used.
The touch panel 28 is a display capable of touch operation. The touch panel 28 is a display device in the portable terminal 20, and is an input device. The portable terminal 20 may include a mechanical button, a keyboard, a mouse, and the like in addition to the touch panel 28.
The communication circuit 30 is a circuit for connecting to a network such as the internet 120. The camera 32 captures moving images and still images and converts the images into image data, and the microphone 34 converts sound into sound data.
As shown in fig. 3, the portable terminal 20 is configured with an attribute information input unit 40, an integrated API (Application Programming Interface) calling unit 42, a beacon receiving unit 44, a display unit 50, and an execution result accuracy input unit 52, in addition to the camera 32 and the microphone 34. They are constructed by controlling hardware of the portable terminal 20 with software such as an OS (operating system), an application (application program), and the like.
The camera 32 is an example of a data acquisition unit, and acquires image data as processing target data by the operation of the maintenance person 300. The microphone 34 is also an example of a data acquisition unit, and acquires audio data as processing target data by the operation of the maintenance person 300.
The attribute information input unit 40 is an example of an attribute acquisition means, and acquires attribute data indicating an attribute relating to building equipment or maintenance management work. The attribute related to the building device is information indicating the characteristics of the building device, such as the type of the building device, the manufacturer name of the building device, the type of the building device, and the installation location of the building device. The types of building equipment refer to air conditioning, electrical, lighting, and the like. The manufacturer name of the building device refers to the name of the business that manufactured or sold the building device. The form of building equipment typically refers to the identification information that manufacturers assign to each device of different specifications.
The attribute related to the maintenance management work is information indicating the characteristics of the maintenance management work, such as the type of the maintenance management work, the place where the maintenance management work is performed, the name of a maintenance person who performs the maintenance management work, and the time when the maintenance management work is performed. Here, the types of maintenance work include types related to building equipment such as air conditioning, electrical equipment, and lighting, and types of work modes such as inspection, repair, and replacement. The implementation place of the maintenance management operation can be represented by large classifications such as outdoor and indoor, middle classifications such as roof, underground, corridor, stair, toilet, indoor and good layers, small classifications such as good-layer good-quality room, good-layer good-quality tenant good-quality.
The attribute information input unit 40 is configured to receive an operation of the touch panel 28 by the maintenance worker 300 and acquire attribute data, for example. Alternatively, it is also possible to estimate and automatically set the attributes in consideration of the screen state of the application, the position information of a GNSS (Global Navigation Satellite System), and the like, of the application of the mobile terminal 20 operated by the maintenance person 300. Of course, the result of the automatic setting may be a result that the maintenance person 300 can change. In another embodiment, it is conceivable to read an RFID (Radio Frequency IDentifier) or the like provided in the building equipment and acquire attribute data from information contained therein.
The integrated API calling unit 42 is an example of a service requesting unit, and requests the support server 60 to execute an information processing service. The request is made by transmitting image data from the camera 32 or sound data from the microphone 34, and attribute data from the attribute information input section 40. The integrated API calling unit 42 is also an example of a result acquiring means, and receives the execution result of the information processing service from the support server 60.
The beacon receiver 44 is an example of a beacon receiving unit, and receives a beacon, which is a wireless signal transmitted from a building device. The beacon typically contains information about attributes associated with the building device, such as the device's class. The beacon receiving unit 44 is provided with an attribute acquiring unit 46 and an attribute correctness determining unit 48. The attribute acquisition unit 46 is an example of an attribute acquisition means, and analyzes a beacon to acquire attribute data relating to the building equipment. The attribute correctness determination unit 48 is an example of a determination means, and when the integrated API calling unit 42 receives the execution result of the information processing service from the support server 60 and the execution result includes attribute data, compares the attribute data with the attribute data obtained from the beacon. If the two are found to be out of match as a result of the comparison, the display unit 50 or the like displays the information and gives the maintenance worker 300 an opportunity to correct the information.
The display unit 50 is formed by the touch panel 28, and performs various displays such as display for operation and display of the execution result of the information processing service. Further, the maintenance worker 300 can perform input for correction when the display result of the information processing service displayed on the display unit 50 is incorrect.
The execution result correctness input unit 52 is provided for the maintenance person 300 to input whether or not the result displayed on the display unit 50 is correct. The input result can also be used to evaluate the execution result of the information processing service by the external system a 130, the external system B140, the external system C150, and the like.
The assist server 60 will be described in detail with reference to fig. 4 and 5. Fig. 4 is a diagram schematically showing the hardware configuration of the assist server 60. Fig. 5 is a diagram schematically showing functions built in the support server 60.
The support server 60 is an example of a maintenance work support device, and is a computer installed in a building where building equipment is installed, a maintenance company, or the like. The assist server 60 is constructed using a computer such as a PC. As shown in fig. 4, the auxiliary server 60 has a bus 62, a processor 64 connected to the bus 62, a memory 66, a touch panel 68, and a communication circuit 70. The processor 64, the memory 66, the touch panel 68, and the communication circuit 70 are hardware similar to the processor 24, the memory 26, the touch panel 28, and the communication circuit 30 of the mobile terminal 20 shown in fig. 2, and description thereof is omitted.
The assist server 60 controls hardware of the assist server 60 with software such as an OS, an application, and the like, thereby constructing functions shown in fig. 5. As shown in fig. 5, the support server 60 includes an integrated API management unit 80, an individual API calling unit 82, an API selection unit 90, a selection rule holding unit 94, a selection rule setting/updating unit 96, and a result determination/accumulation unit 98.
The integrated API management unit 80 is an example of an acquisition means, and acquires processing target data such as image data and audio data and attribute data from the integrated API calling unit 42 of the mobile terminal 20, and receives a request for an information processing service for the processing target data. In this case, the integrated API management unit 80 transmits the type and attribute data of the service to be used to the API selection unit 90, inquires which external system is selected, and receives a response from the API selection unit 90. Then, the integrated API managing section 80 instructs the individual API calling section 82 to utilize the information processing service of the selected external system, and transmits the processing target data. The integrated API management unit 80 is also an example of a transmission means, and transmits the execution result of the information processing service to the mobile terminal 20.
The individual API calling unit 82 is an example of a request unit, and requests the external system to execute the information processing service in accordance with an instruction from the integrated API management unit 80. The individual API calling unit 82 is provided with an external system a calling unit 84. The external system a calling unit 84 calls an API provided by the external system a 130, transmits the processing target data and data necessary for the request of the information processing service, and executes the information processing service to obtain the execution result. Similarly, the individual API calling unit 82 is provided with an external system B calling unit 86 for calling the API of the external system B140 and an external system C calling unit 88 for calling the API of the external system C150. When there is an available external system, the individual API calling unit 82 is constructed with respect to the external system.
The API selection unit 90 is an example of a selection means, and performs selection of an information processing service for which external system is used. The API selecting unit 90 is provided with an attribute identifying unit 92. The attribute identifying unit 92 identifies information of the attribute from the attribute data. Then, the external system to be used is selected under the attribute with reference to the selection rule held by the selection rule holding unit 94.
The selection rule holding unit 94 holds a selection rule that is a rule for selecting an external system. The selection rules are determined for each information handling service desired to be utilized and for each appropriate attribute.
The selection rule setting/updating section 96 is an example of updating means, and performs initial setting of a selection rule and subsequent updating. The selection rule setting/updating unit 96 updates the selection rule concerning the information processing service and the attribute thereof by evaluating the result of actually using all the available external systems with the appropriate attribute for each information processing service. Specifically, the selection rule setting/updating unit 96 causes the individual API calling unit 82 to request the information processing service for all the external systems that have been set, and causes the result determination/accumulation unit 98 to evaluate the obtained execution result, thereby updating the selection rule.
The result determination/accumulation unit 98 is an example of a determination unit and an update unit, and acquires the execution result of the information processing service from the individual API calling unit 82 and evaluates the result. The result determination/accumulation unit 98 includes an accuracy determination unit 100, a majority vote determination unit 102, and a precision determination unit 104 as components for evaluation.
When the external system performs the information processing service, the accuracy determination unit 100 compares the execution results using the accuracy data output together with the execution results. Here, the accuracy is information provided from an external system as information indicating the accuracy or the like of the execution result of the information processing service. The accuracy is expressed, for example, by 0 as the lowest point and 100 as the full point. However, the calculation algorithm of the accuracy generally differs depending on the external system. Therefore, in order to be able to compare the accuracy of different external systems, adjustments are made as necessary. For example, the conversion formula can be set by the administrator from a theoretical viewpoint and adjusted. Further, for example, the conversion formula may be set and adjusted based on the result that the maintenance person 300 actually evaluates that the execution result is incorrect. The determination result of the accuracy determination unit 100 is used to determine the execution result transmitted from the integrated API management unit 80 to the mobile terminal 20 in support of the normal maintenance management operation. In addition, the determination result of the accuracy determination section 100 can also be used as update information of the selection rule in the selection rule setting/updating section 96.
When 3 or more external system information processing services are used, the majority decision unit 102 decides a highly appropriate execution result by a majority decision method. That is, when the information processing services of the plurality of external systems obtain the same execution result, it is determined that the execution result is highly appropriate. When the result of the majority vote is vote dispersion (that is, when there are a plurality of 1 st bits), the determination may be made by another method such as the determination result requested to the accuracy determination unit 100. The decision result of the majority decision unit 102 is used to decide the execution result to be transmitted from the integrated API management unit 80 to the mobile terminal 20, while assisting the normal maintenance management operation. The determination result of the majority vote determination unit 102 can also be used as update information of the selection rule in the selection rule setting/updating unit 96.
The accuracy determination unit 104 actually evaluates the correctness of the execution result by the maintenance person 300, and determines an accurate execution result based on the result. The determination by the accuracy determination unit 104 is used as, for example, update information of the selection rule in the selection rule setting/updating unit 96.
Fig. 6 is a schematic diagram showing the functions of the external system a 130. External system A130 includes an API 132, an OCR service 134, an image recognition service 136, and a voice recognition service 138.
The API 132 is an interface provided by the external system a 130 to utilize information processing services of the external system a 130. The user using the external system a 130 can obtain the execution result of the information processing service by calling the API and transmitting prescribed data.
The OCR service 134 is an information processing service that generates a character code from characters (including numerals, symbols, and the like) included in image data. In the maintenance management work assistance system 10, the OCR service 134 is used, for example, to character-encode characters described in signs 312 and the like in the building equipment.
The image recognition service 136 is an information processing service that recognizes a person, an object, or the like included in the image data. In the image recognition service 136, pattern matching may also be performed that associates the recognized person or object with a particular person or object. In the maintenance management job assisting system 10, the image recognition service 136 is used, for example, to extract components from image data of components of the building equipment and determine the manufacturer, model, and the like of the extracted components.
The voice recognition service 138 is an information processing service that generates character codes from the voice data. In the voice recognition service 138, semantic analysis of character codes and the like may also be performed. In the maintenance work support system 10, the voice recognition service 138 is used, for example, for the maintenance person 300 to orally write a record of the maintenance work.
In addition to the translation service for translating between languages, various information processing services such as a dictionary search service for investigating the meaning of a term can be provided in the external system a 130. The external system B140 and the external system C150 provide various information processing services including information processing services similar to the external system a 130, such as an OCR service, an image recognition service, a voice recognition service, a translation service, and a dictionary search service. Here, the same type of information processing service refers to a service capable of performing substantially the same type of information processing.
The external system a 130, the external system B140, and the external system C150 are each constructed using 1 or more computers connected to the internet 120. Also, the information processing services provided by these systems are structured to be utilized by various users in the form of so-called cloud computing. The maintenance work support system 10 is configured to use these external systems for supporting maintenance work.
(2) Actions of the System
Examples of the operation and operation of the system according to the embodiment will be described with reference to fig. 7 to 12.
Fig. 7 is a sequence diagram illustrating the operation of the maintenance work assisting system 10 when assisting the normal maintenance management work. The maintenance person 300 operates the mobile terminal 20 to start an application for maintenance and management work. Then, the maintenance person 300 uses the camera 32 of the portable terminal 20 to photograph the sign 312 of the building equipment to be subjected to the maintenance management work (S10).
Fig. 8 schematically illustrates an example of the signboard 312. The label 312 describes information containing a product name "good quality good", a model name "ABC-DEFGH", a manufacturing number "12JKLMN", and a manufacturer name "X", which is a company name. The product name is a name of the building device, and for example, in the case where the building device is an outdoor unit of an air conditioning system, a name such as "air conditioning outdoor unit" or a name of a registered trademark is given. The model name is a character string uniquely identifying the same specification product among the products of the manufacturer. In the example of fig. 8, "ABC" in the model name is a character string indicating that the model is an air conditioner outdoor unit, and "DEFGH" is a character string indicating a specific specification in the air conditioner outdoor unit. The manufacturing number is a character string that uniquely determines each product having each form.
Fig. 9 is a diagram schematically showing the mobile terminal 20 in a state where the sign 312 is photographed by the camera 32. The name of an application named "device information management tool" is displayed on the display unit 50 of the mobile terminal 20. In fig. 9, it is assumed that the application is set as a screen for performing OCR processing. The display unit 50 displays 160 the image data generated by the camera 32 under the description of "captured image". The display 160 contains the photographed sign 312. In the application, the image data is regarded as processing target data to be subjected to the OCR processing, and a request for performing the OCR processing is transmitted to the integrated API calling unit 42 (S12).
The integrated API calling unit 42 is required to input attribute information in order to perform OCR processing. In the example shown in fig. 9, an attribute input field 162 is provided under the description of "input attribute". A triangle button 164 is provided in the input field 162, and when the triangle button 164 is pressed, candidates for input are displayed. In the example shown in fig. 9, "X company air conditioner (outdoor)" is input as the attribute (S14). Further, as described above, the attribute may be input by receiving a beacon, for example.
In the example shown in fig. 9, a send button 166 and a return button 168 are also displayed under the description of "send to assist server". When the maintenance worker 300 presses the send button 166, the integrated API calling unit 42 adds the image data and the attribute data and requests an OCR processing request to the support server 60 (S16).
In the support server 60, the integrated API management unit 80 acquires an OCR processing request, image data, and attribute data. In this case, the integrated API managing unit 80 transmits the attribute data to the API selecting unit 90, and requests selection of the external system to be used and the corresponding API (S18). In the API selection unit 90, the attribute identification unit 92 identifies a desired attribute from the attribute data. Then, the API selecting unit 90 refers to the selection rule held by the selection rule holding unit 94, and selects an external system to which a request for OCR processing is to be made for the identified attribute (S20). The information on the selected external system is transmitted from the API selecting unit 90 to the integrated API managing unit 80 (S22).
Fig. 10 is a diagram showing an example of the selection rule held by the selection rule holding unit 94. The selection rule is set for each category of information processing service. Figure 10 shows selection rules relating to an OCR service. In the example of fig. 10, the manufacturer of the device, the type of the device, and the location of the device are set as the attributes in the selection rule. The manufacturer of the device is set with company X (ltd. X) and other companies (other companies). As the type of the equipment, electric equipment, air conditioner, and the like are set. Further, the locations of the devices are set as indoor and outdoor. In the example shown in fig. 9, "X corporation air conditioner (outdoor)" is input as an attribute, and matches the attribute of the column surrounded by the thick frame 170.
The division of manufacturers as devices into X companies and other companies is due to the fact that it is characteristic to assume that the placard characters of X company are different from those of other companies. In the OCR processing relating to the X company and the OCR processing relating to the other companies, since a difference is seen in a tendency of accuracy, classification is performed in this way.
Similarly, since the electric equipment, the air conditioner, and the like are provided as the types of equipment, the signs of the electric equipment and the air conditioner have characteristics, respectively, and the accuracy tends to vary in the OCR processing. In addition, since the deterioration degree of the label and the light condition are different between indoors and outdoors, the values of the attributes are differentiated.
The selection rule is also provided with a column of external systems, and a plurality of external systems represented by the external system a 130, the external system B140, and the external system C150 are set. When focusing on the inside of the thick box 170, the value "request 96%" is input to the external system a 130. This means that the accuracy of the OCR service of the external system a 130 is about 96% under the attribute condition, (here, it is assumed that the OCR service is requested if it is higher than 95%). For the external system B140, a value of "93% noncommitted" is input. In the external system B140, the accuracy is set to a value as low as about 93% under the attribute condition, and therefore, the OCR service is not requested. In addition, a value of "request 97%" is set for the external system C150. That is, in the external system C150, the accuracy is as high as about 97%, and therefore, the OCR service is set to be requested. In the selection rule, similarly, a value for requesting each external system is set under the condition of other attributes.
Referring to the selection rule shown in fig. 10, the API selection unit 90 responds to the integrated API management unit 80 to select the external system a 130 and the external system C150 (and other external systems (not shown)). Then, the integrated API managing unit 80 instructs the individual API calling unit 82 to call the selected API of each external system and request OCR processing (S24). When instructed, the integrated API managing unit 80 also transmits image data to be processed to the individual API calling unit 82.
The individual API calling unit 82 calls the selected API of each external system and requests OCR processing (S26). When requesting OCR processing, image data and specific data (which will be referred to as API parameters) requested by each API are transmitted. The API parameters store data specific to each API, such as a registered user name to the external system and the type of electronic file storing the execution result.
In each of the external system a 130 and the external system C150, OCR processing is performed on the image data with reference to the information input to the API. In the OCR processing, character codes as execution results and data of accuracy of the execution results are output. The external system a 130 and the external system 150 store the execution result and the accuracy data in a predetermined electronic file and transmit the electronic file to the assist server 60 through the API (S28).
In the support server 60, the individual API calling unit 82 receives the execution result and the accuracy data of each API. Then, the individual API calling unit 82 sends each execution result and the accuracy data to the result determination/accumulation unit 98, and a determination request is made as to which execution result is to be used (S30).
The accuracy determination section 100 of the result determination/accumulation section 98 performs determination based on the accuracy. Fig. 11 shows an example of the accuracy obtained together with the execution result. In the illustrated example, the accuracy of external system A130 is 97% and the accuracy of external system C150 is 96%. Therefore, it is determined that the accuracy of the OCR service of the external system a 130 is the highest, and the execution result of the OCR service is accumulated (S32).
The result determination/accumulation unit 98 transmits the accumulated OCR execution results of the external system 130 to the integrated API management unit 80 (S34). Then, the integrated API management unit 80 transmits the OCR result to the mobile terminal (S36).
In the mobile terminal 20, the integrated API calling unit 42 receives the OCR result. The integrated API calling unit 42 analyzes the OCR result and displays a predetermined item on the display unit 50.
Fig. 12 is a diagram showing a case where the OCR results are displayed on the application screen of the display unit 50. In the display unit 50, the results of the model name "ABC-DEFGH" and the manufacture number "12JKLMN" are displayed 180 under the description of the "OCR result". In the example shown in fig. 12, the model name and the manufacture number of the OCR result coincide with those described in the sign 312 shown in fig. 8. Therefore, the maintenance person 300 does not need to make an adjustment.
In a state where the communication state is not impaired, the time required from the execution of the OCR processing request in step S16 to the display of the execution result in step S38 is short (for example, within 1 second), and the model name and the manufacturing number can be obtained very quickly as compared with a case where the maintenance person 300 inputs the model name and the manufacturing number by himself/herself.
However, a situation may also occur in which the OCR results are different from the description of the sign 312. For example, errors of the number "0" and the letter "O", errors of the number "1" and the lower case "l" occur frequently. Therefore, a notice of "please correct if incorrect" is displayed on the display unit 50, and the value can be changed by touching the screen. When a value is input by touching the screen, the execution result correctness input unit 52 operates to rewrite the execution result.
Alternatively, when the beacon is received by the beacon reception unit 44, the OCR result can be compared with the reception content of the beacon. That is, the attribute correctness determination unit 48 compares the two and displays the result on the display unit 50 when there is a mismatch therebetween. In the case of the non-matching OCR-based operation, the maintenance person 300 may touch the screen to directly input a value or may perform an operation of replacing the value with a signal of a beacon. In addition, when there is an error in the signal of the beacon, processing for correcting the signal of the beacon is separately performed.
The display unit 50 also records "register to assist server? ", below which a registration button 182 and a return button 184 are displayed. When the registration button 182 is pressed, the OCR result is deterministically registered in the auxiliary server 60. Although not shown, the result of the maintenance management work for the building equipment is input to the mobile terminal 20 on the next screen. In the maintenance management work using the mobile terminal 20, the application of the mobile terminal 20 communicates with the support server 60 as appropriate, and records the work content. The support server 60 can perform various services such as creation of a service report and confirmation of a failure based on the record.
In addition, in the assist server 60, the OCR result can also be evaluated using the model name and the manufacturing number registered by the maintenance person 300 pressing the registration button 182. Specifically, the OCR result is evaluated in the accuracy determination unit 104 of the result determination/accumulation unit 98. The selection rule may also be updated based on the evaluation result.
In the above description, an example is shown in which the accuracy determination unit 100 of the assist server 60 transmits the execution result determined to have the highest accuracy to the mobile terminal 20. Instead of this method, the execution result transmitted to the mobile terminal 20 may be determined by the majority decision method of the majority decision unit 102. The majority voting scheme can be generally adopted when the derived information processing service is implemented in 3 or more external systems.
Next, a procedure of updating the selection rule will be described. In the external system, the algorithm of the information processing service may be changed by being transmitted to the user, or the algorithm of the information processing service may be changed without being transmitted to the user. Therefore, the accuracy of the execution result of the information processing service changes. Therefore, the assist server 60 updates the selection rule periodically or at a timing when the algorithm is changed.
When updating the selection rule, the selection rule setting/updating unit 96 changes the process flow in the support server 60. Specifically, the API selection unit 90 selects all available external systems instead of selecting a part of the external systems according to the selection rule. Then, the result determination/accumulation unit 98 evaluates the execution results of all external systems, and updates the selection rule based on the evaluation results. The updating of the selection rule is performed for each attribute.
Further, if the selection rule is updated based on the result of 1-time shooting by the camera 32, it is greatly affected by an error or the like at the time of shooting. Therefore, it is considered that the selection rule is preferably changed based on the execution result of a plurality of times (for example, 10 times or more or 30 times or more). As described above, the selection rule may be updated based on the result of the majority decision unit 102 or the precision decision unit 104, not based on the result of the accuracy decision unit 100.
In the above description, the selection rule shown in fig. 10 is taken as an example, and a mode of selecting an information processing service of an external system is shown. However, a rule other than the rule shown in fig. 10 may be used as the selection rule. The selection rule is set as a countermeasure for a case where the result of the information processing service differs depending on the attribute. Therefore, the attributes that do not cause a difference much need only be excluded from the selection rule. For example, in the selection rule shown in fig. 10, it is considered that only 1 or 2 items are reserved from the manufacturer of the device, the type of the device, and the location of the device, and the other attributes are excluded from the selection rule. In addition, when a large difference occurs due to other attributes not described in the selection rule shown in fig. 10, the selection rule may be newly incorporated. As an example, it is conceivable that information of the job time is included as an attribute, and the selection rule is made different between the daytime time zone and the night time zone. In the day and night, particularly, the illuminance outside changes, and therefore, the accuracy of the OCR process sees a difference.
The above description has been made taking the OCR service as an example. However, also the execution result of the image recognition service or the voice recognition service depends on, for example, brightness of the surroundings, noise of the surroundings, and the like. Therefore, it is effective to set the selection rule according to the attribute.
Description of the reference symbols
10: maintaining the management work auxiliary system; 20: a portable terminal; 22: a bus; 24: a processor; 26: a memory; 28: a touch panel; 30: a communication circuit; 32: a camera; 34: a microphone; 40: an attribute information input unit; 42: an integrated API calling unit; 44: a beacon receiving unit; 46: an attribute acquisition unit; 48: an attribute correctness determination unit; 50: a display unit; 52: an input section; 60: an auxiliary server; 62: a bus; 64: a processor; 66: a memory; 68: a touch panel; 70: a communication circuit; 80: an integrated API management unit; 82: an individual API call unit; 84: an external system A calling unit; 86: an external system B calling unit; 88: an external system C calling unit; 90: an API selection section; 92: an attribute identification unit; 94: a selection rule holding unit; 96: a selection rule setting/updating section; 98: a result determination/accumulation unit; 100: an accuracy determination unit; 102: a majority vote determination section; 104: a precision determination unit; 110: a central monitoring device; 120: an internet; 130: an external system A;134: an OCR service; 136: an image recognition service; 138: a voice recognition service; 140: an external system B;150: an external system C;160: displaying; 162: an input field; 164: a triangular button; 166: a send button; 168: a return button; 170: a coarse frame; 180: displaying; 182: a registration button; 184: a return button; 300: maintenance personnel; 310: an outdoor unit; 312: provided is a label.

Claims (14)

1. A maintenance work support device is characterized by comprising:
an acquisition unit that acquires attribute data indicating an attribute related to a building device or a maintenance management operation from a portable terminal used for the maintenance management operation of the building device, and processing target data used for the maintenance management operation;
a selection unit that selects an information processing service to be executed as a request from among a plurality of information processing services of the same type provided by a plurality of external systems, in accordance with a selection rule set for the attribute;
a request unit which calls an API corresponding to the selected information processing service, transmits the processing object data, and requests execution of the information processing service;
a receiving unit that receives an execution result of an information processing service through the API; and
a transmission unit that transmits the received execution result of the information processing service to the portable terminal.
2. The maintenance management work assisting apparatus according to claim 1,
the maintenance management work support apparatus includes an updating unit that selects a plurality of information processing services of the same type provided by the plurality of external systems, requests execution by the requesting unit, receives execution results by the receiving unit, compares the received execution results of the respective information processing services, and updates the selection rule set for the attribute.
3. The maintenance management work assisting apparatus according to claim 2,
the receiving unit obtains data of accuracy of the execution result together with the execution result,
the updating unit updates the selection rule in such a manner that the information processing service for which the execution result with high accuracy is obtained is the information processing service of the request object relating to the attribute.
4. The maintenance management work assisting apparatus according to claim 2,
the updating means updates the selection rule so that the information processing service for which the execution result with high accuracy is obtained is the information processing service to be requested regarding the attribute, by transmitting the execution result of each information processing service to the mobile terminal via the transmitting means and acquiring data on the accuracy of the execution result of each information processing service from the mobile terminal.
5. The maintenance management work assisting apparatus according to claim 1,
the selection unit selects 2 or more information processing services of the same kind,
the request unit requests execution of the selected 2 or more information processing services,
the receiving unit receives execution results of the selected 2 or more information processing services,
the maintenance work support device further includes a determination unit that compares the execution results of the 2 or more information processing services received by the reception unit and determines the execution result of the 1 information processing service to be transmitted,
the transmitting unit transmits the 1 execution result determined by the determining unit to the mobile terminal.
6. The maintenance management work assisting apparatus according to claim 5,
the receiving unit obtains data of accuracy of the execution result together with the execution result,
the determination unit determines the information processing service for which the execution result with high accuracy is obtained as the transmission target.
7. The maintenance work assisting apparatus according to claim 1,
the attribute data includes data representing a manufacturer of the building device,
the selection rule is set according to the manufacturer.
8. The maintenance work assisting apparatus according to claim 1,
the attribute data is data representing a category of the building device,
the selection rule is set according to a category of the building device.
9. The maintenance management work assisting apparatus according to claim 1,
the attribute data is data indicating an installation location of the building device,
the selection rule is set according to whether an installation place of the building device is outdoor or indoor.
10. The maintenance management work assisting apparatus according to claim 1,
the attribute data is data indicating a job time of the maintenance management job,
the selection rule is set according to whether the operation time of the maintenance management operation is day time or night time.
11. The maintenance management work assisting apparatus according to claim 1,
the processing object data is image data,
the information processing service is an OCR service that generates character codes from the image data.
12. A maintenance work portable terminal is characterized by comprising:
a data acquisition unit that acquires processing target data used for maintenance management work for the building equipment;
an attribute acquisition unit that acquires attribute data indicating an attribute relating to the building equipment or the maintenance management work;
a requesting unit that transmits the processing target data and the attribute data and requests an information processing service for the processing target data; and
and a result acquisition unit that acquires an execution result of the information processing service selected based on the attribute, from among a plurality of heterogeneous information processing services provided by a plurality of external systems.
13. The portable terminal for maintenance management work according to claim 12,
the maintenance management work portable terminal has a receiving unit that receives a beacon transmitted from the building equipment,
the attribute acquisition unit acquires the attribute data from the received beacon.
14. The portable terminal for maintenance management work according to claim 12,
the processing target data is image data obtained by shooting a picture for specifying the display of the building device,
the information processing service is an OCR service that generates character codes determining the building devices as the execution results from the image data,
the beacon is a signal containing data identifying the building device,
the attribute data acquired by the attribute acquisition unit includes data for specifying the building device,
the maintenance management work portable terminal includes a determination unit that compares the character code acquired by the result acquisition unit with the data specifying the building device acquired by the attribute acquisition unit, and determines a mismatch in the display specifying the building device or the beacon.
CN202080100860.6A 2020-05-15 2020-05-15 Maintenance management operation support device and maintenance management operation portable terminal Active CN115552446B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/019440 WO2021229795A1 (en) 2020-05-15 2020-05-15 Maintenance management work support device and maintenance management work mobile terminal

Publications (2)

Publication Number Publication Date
CN115552446A true CN115552446A (en) 2022-12-30
CN115552446B CN115552446B (en) 2023-10-31

Family

ID=78525591

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080100860.6A Active CN115552446B (en) 2020-05-15 2020-05-15 Maintenance management operation support device and maintenance management operation portable terminal

Country Status (3)

Country Link
JP (1) JP7162778B2 (en)
CN (1) CN115552446B (en)
WO (1) WO2021229795A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7486687B1 (en) 2023-07-11 2024-05-17 三菱電機株式会社 Specification confirmation device, specification confirmation system, and specification confirmation method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10187812A (en) * 1996-12-26 1998-07-21 Hitachi Building Syst Co Ltd Maintenance work managing system for building
JP2005228025A (en) * 2004-02-13 2005-08-25 Marusei Co Ltd Maintenance management system for building
JP2008293354A (en) * 2007-05-25 2008-12-04 Canon Inc Document image recognition system
CN101751560A (en) * 2008-12-12 2010-06-23 西门子公司 Method, control program and system for identifying a container in a container crane assembly
CN102298696A (en) * 2010-06-28 2011-12-28 方正国际软件(北京)有限公司 Character recognition method and system
CN105093938A (en) * 2015-03-13 2015-11-25 霍尼韦尔环境自控产品(天津)有限公司 Building control system design and maintenance device and method

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5476752B2 (en) * 2009-03-13 2014-04-23 株式会社リコー Information processing apparatus, information processing method, and program
JP5821417B2 (en) * 2011-08-30 2015-11-24 コニカミノルタ株式会社 Service evaluation system, image forming apparatus, and program
WO2014024251A1 (en) * 2012-08-06 2014-02-13 富士通株式会社 Cloud service selection device, cloud service selection system, cloud service selection method, and cloud service selection program
JP2015064857A (en) * 2013-09-02 2015-04-09 株式会社リコー Character recognition system, character recognition control method, and character recognition control program
JP6606890B2 (en) * 2015-07-08 2019-11-20 富士ゼロックス株式会社 Information processing apparatus and information processing program
JP6763245B2 (en) * 2016-09-13 2020-09-30 富士ゼロックス株式会社 Information processing equipment and information processing programs
CN110415796A (en) * 2018-04-27 2019-11-05 通用电气公司 For the assets management method of Medical Devices, asset management platform, computer readable storage medium and mobile terminal
CN110647784A (en) * 2018-06-27 2020-01-03 中国移动通信集团浙江有限公司 Equipment asset management method and device based on deep learning

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10187812A (en) * 1996-12-26 1998-07-21 Hitachi Building Syst Co Ltd Maintenance work managing system for building
JP2005228025A (en) * 2004-02-13 2005-08-25 Marusei Co Ltd Maintenance management system for building
JP2008293354A (en) * 2007-05-25 2008-12-04 Canon Inc Document image recognition system
CN101751560A (en) * 2008-12-12 2010-06-23 西门子公司 Method, control program and system for identifying a container in a container crane assembly
CN102298696A (en) * 2010-06-28 2011-12-28 方正国际软件(北京)有限公司 Character recognition method and system
CN105093938A (en) * 2015-03-13 2015-11-25 霍尼韦尔环境自控产品(天津)有限公司 Building control system design and maintenance device and method

Also Published As

Publication number Publication date
JPWO2021229795A1 (en) 2021-11-18
CN115552446B (en) 2023-10-31
JP7162778B2 (en) 2022-10-28
WO2021229795A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
US10025657B2 (en) Information processing system and failure diagnosis method
US8689293B2 (en) Access control device, access control method, program, storage medium, and integrated circuit
WO2013035687A1 (en) Work management system, work management terminal, program and work management method
US9544548B2 (en) Object image displaying system
US10901834B2 (en) Interactive troubleshooting assistant
WO2020202825A1 (en) Information provision system, and information provision method
WO2020202824A1 (en) Information provision system, and information provision method
CN110972519B (en) Information providing system and information providing method
WO2019125060A1 (en) Electronic device for providing telephone number associated information, and operation method therefor
CN111488821B (en) Method and device for identifying countdown information of traffic signal lamp
US20130266228A1 (en) Automatic part identification and workflow generation
CN115552446B (en) Maintenance management operation support device and maintenance management operation portable terminal
CN105631715A (en) Advertisement updating supervision method and device
US20200293877A1 (en) Interactive assistant
JP6899797B2 (en) Inquiry device identification system, inquiry device identification method
CN109445388A (en) Industrial control system data analysis processing device and method based on image recognition
JP2013220917A (en) Technological support system of elevator
CN113468541B (en) Identification method, identification device, electronic equipment and storage medium
US20210065468A1 (en) Systems and methods for artificial intelligence in a vehicle service environment
WO2021241938A1 (en) Electronic device and control method therefor
CN112714056B (en) Real-time property communication method and real-time property communication system
WO2022197034A1 (en) Apparatus for determining successful candidate for recruitment in recruitment brokerage service, and method therefor
EP4148604A1 (en) Information processing apparatus, information processing method, and program
WO2024038950A1 (en) Item information management method, and electronic device for providing same
JP2021189827A (en) Electronic apparatus, log collection system, and method for controlling electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant