WO2023166672A1 - Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic - Google Patents

Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic Download PDF

Info

Publication number
WO2023166672A1
WO2023166672A1 PCT/JP2022/009183 JP2022009183W WO2023166672A1 WO 2023166672 A1 WO2023166672 A1 WO 2023166672A1 JP 2022009183 W JP2022009183 W JP 2022009183W WO 2023166672 A1 WO2023166672 A1 WO 2023166672A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
dimensional code
output data
photographed
information
Prior art date
Application number
PCT/JP2022/009183
Other languages
English (en)
Japanese (ja)
Inventor
喜範 山田
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2022568955A priority Critical patent/JP7461510B2/ja
Priority to PCT/JP2022/009183 priority patent/WO2023166672A1/fr
Publication of WO2023166672A1 publication Critical patent/WO2023166672A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations

Definitions

  • the present disclosure relates to a diagnostic system, control device, diagnostic method, and diagnostic program for diagnosing a machine.
  • Patent Document 1 discloses information stored in a device's information storage memory as a two-dimensional code. A technique for saving the user's trouble by doing so has been disclosed.
  • the present disclosure has been made in view of the above, and aims to obtain a diagnostic system capable of increasing the amount of diagnostic information that can be presented.
  • a diagnostic system controls a machine and divides output data used for at least one of machine diagnosis and maintenance to obtain a plurality of divided data. is added to each of the plurality of divided data to generate transmission data by adding data identification information, which is identification information of the output data, and division information indicating the order of the divided data, and converts the transmission data into a two-dimensional code.
  • a control device displays a two-dimensional code, and the photographed data, which is data of an image in which the displayed two-dimensional code is photographed, is received from the information terminal that photographed the image, and the two-dimensional code is extracted from the photographed data.
  • a server that decodes the extracted two-dimensional code and restores output data from a plurality of pieces of decoded information using data identification information and division information included in the decoded information obtained by decoding.
  • the diagnostic system according to the present disclosure has the effect of increasing the amount of diagnostic information that can be presented.
  • FIG. 1 is a diagram showing a configuration example of a diagnostic system according to a first embodiment
  • FIG. 4 is a diagram showing an example of data generated by a transmission data conversion unit and a two-dimensional code generation unit of the control device according to Embodiment 1;
  • FIG. 4 is a diagram showing an example of a photographed image taken by the mobile information terminal of Embodiment 1;
  • a diagram showing an example of a two-dimensional code according to Embodiment 1 4 is a flowchart showing an example of the operation of the server according to the first embodiment;
  • 1 is a diagram showing a configuration example of a computer system that implements the control device of Embodiment 1;
  • FIG. 11 is a diagram showing an example of data generated by the transmission data conversion unit and the two-dimensional code generation unit of the control device according to the second embodiment when compression processing is applied to the output data;
  • FIG. 11 is a diagram showing an example of the size of a two-dimensional code output screen displayed by the control device according to the third embodiment
  • FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1
  • FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1
  • a diagram showing an example of a two-dimensional code displayed by the control device according to the third embodiment The figure which shows the structural example of the diagnostic system concerning Embodiment 4.
  • FIG. 11 is a diagram showing an example of the size of a two-dimensional code output screen displayed by the control device according to the third embodiment
  • FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1
  • FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1
  • FIG. 11 is a diagram showing an example of screen page display switching and its time chart by the automatic page switching unit of Embodiment 4;
  • FIG. 11 is a diagram showing an example of a method for extracting a two-dimensional code image captured as a moving image according to the fourth embodiment;
  • FIG. 11 is a diagram showing an example of a method for extracting a two-dimensional code image when still images are shot continuously according to the fourth embodiment;
  • FIG. 12 is a diagram showing an example of data generated by a transmission data conversion unit and a two-dimensional code generation unit of a control device according to Embodiment 5; Flowchart showing an example of the operation of the server according to the fifth embodiment The figure which shows the structural example of the diagnostic system concerning Embodiment 6. A diagram showing an example of a characteristic portion of the two-dimensional code display screen of Embodiment 6 A diagram showing an example of diagnosis in the diagnosis system according to the sixth embodiment.
  • Embodiment 1. 1 is a diagram illustrating a configuration example of a diagnostic system according to a first embodiment;
  • the diagnostic system 6 of this embodiment comprises a machine 1 , a server 4 and a response computer 5 .
  • the machine 1 of this embodiment displays a two-dimensional code indicating diagnostic information that is used for at least one of diagnosing the state of the machine 1 and maintenance of the machine 1 .
  • the user of the machine 1 takes a picture of the area containing the two-dimensional code with the portable information terminal 3, which is an example of an information terminal, and the photographed image is transmitted from the portable information terminal 3 to the server 4.
  • the server 4 acquires diagnostic information from the two-dimensional code and outputs the acquired diagnostic information to the reception computer 5 .
  • the response computer 5 performs diagnosis and maintenance using the diagnostic information, and presents the diagnostic results to the user.
  • Server 4 and response computer 5 constitute a diagnostic device.
  • the server 4 and the reception computer 5 are separately provided, but a diagnostic device in which these are integrated may be provided.
  • the portable information terminal 3 may be included in the diagnostic system 6 .
  • the machine 1 since the machine 1 displays the diagnostic information for diagnosing the state of the machine 1 in a two-dimensional code, the machine 1 is not provided with an attachment port for an external storage medium. Diagnostic information of the machine 1 can be sent to the server 4 even if there are restrictions. As a result, the diagnostic system 6 of the present embodiment can perform remote diagnosis and remote maintenance of the machine 1, eliminating the need for a specialized engineer to visit the place where the equipment is installed to perform maintenance.
  • the machine 1 can divide the diagnostic information and convert each of the divided diagnostic information into a two-dimensional code. As a result, the machine 1 can increase the amount of diagnostic information that can be presented as compared to when division is not performed. If the diagnostic information to be presented can be represented by one two-dimensional code, the diagnostic information need not be divided. That is, the number of divisions when dividing diagnostic information may be one.
  • the machine 1 comprises a controller 11 , a drive 16 and a machine signal processor 17 .
  • the machine 1 is, for example, a machine tool that performs machining by numerical control, but is not limited to this.
  • the driving device 16 drives a motor (not shown) of the machine 1.
  • the mechanical signal processing device 17 exchanges mechanical signals with the mechanical peripheral device 2 .
  • the control device 11 controls the operation of the machine 1 and the machine peripherals 2 by controlling the driving device 16 and the machine signal processing device 17 .
  • the machine peripheral device 2 is, for example, an operation panel for controlling the machine 1, or a device that is standardly mounted on the machine 1 or connected to the machine 1 and controlled by a machine signal from the control device 11, but is limited to these. not.
  • the machine signals acquired by the control device 11 include, for example, signals indicating input contents according to operations using an operation panel, signals from sensors attached to the machine 1 for detecting the state of the machine 1, and machine peripheral devices. 2 state signals, etc., but not limited to these.
  • the control device 11 includes a screen display unit 12, a two-dimensional code generation unit 13, a transmission data conversion unit 14, and a memory 15.
  • Memory 15 stores the output data.
  • the output data includes diagnostic information used for diagnosing and/or maintaining machine 1 .
  • the output data includes, for example, information indicating the state of the control device 11, operation history information (log) in the drive device 16, information indicating the state of the drive device 16, and mechanical signals acquired by the mechanical signal processing device 17 from the machine peripheral device 2. etc., but not limited to these.
  • the memory 15 also stores system information of the machine 1 and the like.
  • the system information includes, for example, model names and identification information (manufacturing number, etc.) of the machine 1 and the control device 11, information on components of the device system (system specifications), status information on connected sensors and system components, and the like. Including but not limited to.
  • FIG. 1 is an example, and the diagnostic information in the machine 1 is not limited to the control information of the driving device 16, the machine signal acquired from the machine peripheral device 2, and the like.
  • the transmission data conversion unit 14 divides the output data to generate a plurality of divided data, and each of the plurality of divided data includes data identification information that is identification information of the output data and division information that indicates the order of the divided data.
  • the transmission data conversion unit 14 reads the output data stored in the memory 15 of the control device 11 , divides the read output data, and transmits the divided output data to the server 4 . converts to transmission data in the format defined between For example, the transmission data conversion unit 14 adds a header and a footer, which will be described later, to the divided output data.
  • the header includes, for example, a data name, which is an example of data identification information.
  • the header may include information indicating the number of divisions, which is an example of division information, and a division number, which is an example of division information indicating the order of the divided output data.
  • the transmission data conversion unit 14 divides the output data into each division size, which is a predetermined data size. Examples are not limiting.
  • the division size is, for example, the size obtained by subtracting the data size of the header and footer from the maximum data size of the output data stored in one two-dimensional code.
  • the transmission data conversion unit 14 determines the number of divisions, for example, based on the quotient obtained by dividing the data size of the output data by the division size. If the output data size is divisible by the division size, the quotient is the number of divisions. If the output data size is not divisible by the division size, the quotient plus 1 is the division number. number.
  • the two-dimensional code generation unit 13 generates a two-dimensional code by converting the transmission data received from the transmission data conversion unit 14 into a two-dimensional code, and outputs the two-dimensional code to the screen display unit 12.
  • the screen display unit 12 has a device data output unit 121 , and the device data output unit 121 has a two-dimensional code display unit 122 .
  • the device data output unit 121 generates a device data output screen, which is a screen displayed when the output data of the machine 1 is output to the outside, and displays the generated device data output screen.
  • the device data output screen will be described later.
  • the two-dimensional code display unit 122 displays the two-dimensional code generated by the two-dimensional code generation unit 13 as an image. As a result, the output data stored in the memory 15 is displayed as a two-dimensional code.
  • the output data includes diagnostic information for diagnosing the state of the machine 1 is described here, the information displayed by the machine 1 as a two-dimensional code is not limited to this example.
  • FIG. 2 is a diagram showing an example of the device data output screen of this embodiment.
  • data A indicates the output data, that is, the type of output data or the data name of the output data
  • data B indicates the output destination.
  • the data name of the output data is the file name of the electronic file here, the data name is not limited to this example.
  • data to be output from each output data displayed as data A is selected by a user's operation using input means (not shown in FIG. 1). After that, the user presses the "Transfer A ⁇ B" portion at the bottom of the device data output screen of FIG.
  • the screen display unit 12 may be realized by using a display integrated with input means such as a touch panel, for example. , the data selected by data A is output.
  • SYSTEM.DAT which is an electronic file in which system information of the control device 11 is stored, is selected as output data, that is, data A.
  • the external storage medium can be specified as the transfer destination data B on the device data output screen. cannot be output to an external storage medium.
  • FIG. 3 is a diagram showing an example of a two-dimensional code display screen according to the present embodiment.
  • a QR (Quick Response) code registered trademark
  • the user takes an image of the displayed area including the two-dimensional code using the mobile information terminal 3 and causes the mobile information terminal 3 to transmit data including the image obtained by taking the image to the server 4 . Thereby, the mobile information terminal 3 can transmit the output data of the machine 1 to the server 4 .
  • the mobile information terminal 3 includes a camera 31 , a captured image memory 32 and a network communication section 33 .
  • the camera 31 captures an image, and stores captured image data representing a captured image in a captured image memory 32 .
  • the network communication unit 33 transmits the photographed data stored in the photographed image memory 32 to the server 4 by wireless communication, for example.
  • the communication line between the network communication unit 33 and the server 4 may be wired or wireless, or may be a mixture of wired and wireless.
  • a dashed arrow pointing from the two-dimensional code display unit 122 to the camera 31 is shown. It means being photographed.
  • the server 4 includes a captured image storage unit 41 , an image analysis unit 42 , a two-dimensional code decoding unit 43 , an output data restoration unit 44 and a restoration data storage unit 45 .
  • the server 4 receives, from the portable information terminal 3, photographed data, which is image data obtained by photographing the displayed two-dimensional code, through a communication unit (not shown in FIG. 1).
  • photographed data is stored in the photographed image storage unit 41 .
  • the image analysis unit 42 includes a two-dimensional code detection unit 421.
  • a two-dimensional code detection unit 421 extracts a two-dimensional code from the photographed data. Specifically, the two-dimensional code detection unit 421 reads the photographed data received from the portable information terminal 3 from the photographed image storage unit 41 on a case-by-item basis, and uses the read photographed data to correspond to the two-dimensional code from the photographed image. The image is cut out as a two-dimensional code, and the cut-out two-dimensional code is output to the two-dimensional code decoding section 43 .
  • a case is a unit in which the user transmits information to the response computer 5 in order to make an inquiry to the response computer 5 or to request a diagnosis to the response computer 5. Equivalent to output data before execution. For example, in the example shown in FIG. 2, output data is selected as data A in units of electronic files, so this electronic file corresponds to one case.
  • the two-dimensional code decoding unit 43 decodes the two-dimensional code extracted from the photographed data. Specifically, the two-dimensional code decoding unit 43 decodes the two-dimensional code received from the image analysis unit 42 and outputs decoded information, which is the decoding result, to the output data restoration unit 44 . As a result, transmission data converted into a two-dimensional code by the two-dimensional code generator 13 of the control device 11 of the machine 1 is obtained.
  • the output data restoration unit 44 restores output data from a plurality of pieces of decryption information using data identification information and division information included in the decryption information obtained by decryption. Specifically, the output data restoring unit 44 restores the output data using the decoding result obtained by decoding the two-dimensional code, and stores the restored output data in the restored data storage unit 45 . If the control device 11 of the machine 1 includes a division number in the transmission data, the transmission data is restored by linking the divided output data in the order of the division number. Further, the division information is not limited to the division number, and may be information indicating the time. The output data may be restored by concatenating.
  • the information indicating the time is, for example, the reception time (receiving date and time) of the photographed data or the photographing time (photographing date and time) of the photographed data.
  • information indicating time is added to the photographed data, and the output data restoration unit 44 acquires information indicating time from the image analysis unit 42 via the two-dimensional code decoding unit 43 .
  • the output data restoration unit 44 determines the division order based on the arrangement positions of the plurality of two-dimensional codes in addition to the information indicating the time.
  • the output data restoration unit 44 acquires information about the arrangement position of the two-dimensional code from the image analysis unit 42 via the two-dimensional code decoding unit 43, and the leftmost two-dimensional code has the smallest division number, and the rightmost two-dimensional code has the smallest division number. It may be determined that the division number increases as the number increases.
  • the response computer 5 reads the output data from the restored data storage unit 45 of the server 4, and obtains information indicating the state of the control device 11, operation history information (log) in the drive device 16, and the state of the drive device 16, which are included in the output data. and the machine signal acquired from the machine peripheral device 2 by the machine signal processing device 17, the state of the machine 1 is diagnosed.
  • FIG. 4 is a diagram showing an example of data generated by transmission data conversion section 14 and two-dimensional code generation section 13 of control device 11 of the present embodiment.
  • the processing performed by the transmission data conversion unit 14 is addition of a header and a footer, and the number of divisions is one.
  • FIG. 4 also shows an example in which the user selects "SYSTEM.DAT" as output data, as illustrated in FIG.
  • the transmission data conversion unit 14 reads the electronic file "SYSTEM.DAT" from the memory 15 as output data, and adds a header (transmission header) and a footer (transmission footer) to the read output data. and output to the two-dimensional code generation unit 13 .
  • the footer includes the file name "SYSTEM.DAT", which is the identification information of the output data, and a numerical value indicating the page number.
  • the header and footer are tags indicating the document structure. ⁇ SYSTEM. DAT> and ⁇ /SYSTEM.DAT> as a footer at the end of "SYSTEM.DAT". DAT> is added.
  • the division number indicating the divided output data after division is indicated by the page number
  • ⁇ P1> indicates the start position of the first page
  • ⁇ /P1>. indicates the end position of the first page
  • ⁇ BODY> indicates the start position of the output data, that is, the end position of the header
  • ⁇ /BODY> indicates the end position of the output data, that is, the start position of the footer.
  • the format of the transmission data shown in FIG. 4 is an example, and the specific contents of the header and footer are not limited to this example. Further, as described above, the transmission data conversion unit 14 may perform processing other than adding headers and footers to the output data.
  • the two-dimensional code generation unit 13 converts the transmission data generated by the transmission data conversion unit 14 into a two-dimensional code, as shown in FIG. Note that FIG. 4 shows a state in which the two-dimensional code is displayed as an image.
  • the two-dimensional code display unit 122 displays the two-dimensional code as an image, the two-dimensional code illustrated in FIG. 4 is displayed.
  • the user takes an image of the two-dimensional code displayed on the control device 11 using the mobile information terminal 3 .
  • the user makes an inquiry about the machine 1 to the reception computer 5 or requests a diagnosis.
  • the user first displays the device data output screen shown in FIG. 2, and selects output data while the device data output screen is displayed. Which output data to select may be determined according to the contents of the diagnosis, or may be instructed from the response computer 5 .
  • the process illustrated in FIG. 4 is performed to display the two-dimensional code.
  • FIG. 5 is a diagram showing an example of a photographed image taken by the mobile information terminal 3 of this embodiment.
  • the two-dimensional code and two At least one of tilt and deformation may occur in the portion displayed around the dimension code.
  • the two-dimensional code in the captured image is tilted.
  • the portable information terminal 3 transmits the captured image to the server 4.
  • supplementary information may be transmitted to the server 4 together with the photographed data representing the photographed image.
  • the supplementary information is input to the mobile information terminal 3 by, for example, the user operating input means (not shown).
  • the supplementary information includes, for example, the subject of each inquiry or diagnosis request. Supplemental information may further include text notes of the content of the inquiry, documents for supplementary explanation, images, audio files, and the like.
  • the above-mentioned image obtained by photographing the two-dimensional code includes not only the two-dimensional code but also an image of information indicating supplementary explanation.
  • the photographed image transmitted from the portable information terminal 3 contains both the two-dimensional code and the information indicating the supplemental explanation.
  • the server 4 stores the photographed data received from the portable information terminal 3 in the photographed image storage unit 41 .
  • the server 4 stores the supplementary information in the photographed image storage unit 41 in association with the photographed data.
  • FIG. 6 is a diagram showing an example of the two-dimensional code of this embodiment.
  • FIG. 6 shows a QR code as an example of a two-dimensional code.
  • the QR code as shown in FIG. 6, square shapes are arranged at three of the four corners. By detecting three points per piece, the position, size, direction, and inclination of the QR code included in the image can be detected.
  • FIG. 7 is a flow chart showing an example of the operation of the server 4 of this embodiment.
  • the server 4 extracts the two-dimensional code in the image from the feature amount of the two-dimensional code (step S1).
  • the two-dimensional code detection unit 421 of the image analysis unit 42 reads the photographed data from the photographed image storage unit 41, extracts the feature amount of the two-dimensional code from the photographed image indicated by the read photographed data, and extracts the feature amount. is used to extract a region corresponding to the two-dimensional code in the photographed image.
  • the feature amount is, for example, the shape of three squares shown in FIG.
  • the server 4 cuts out the two-dimensional code image included in the image (step S2). Specifically, the two-dimensional code detection unit 421 of the image analysis unit 42 cuts out the image of the area corresponding to the two-dimensional code extracted in step S1 as a two-dimensional code image, and decodes the cut-out two-dimensional code image. Output to the unit 43 .
  • the two-dimensional code detection unit 421 sequentially performs the processes of steps S1 and S2 on each shot data stored in the shot image storage unit 41 .
  • the server 4 decodes the two-dimensional code of the two-dimensional code image (step S3). Specifically, the two-dimensional code decoding unit 43 converts the two-dimensional code of the two-dimensional code image received from the two-dimensional code detection unit 421 into transmission data, which is data before being converted into the two-dimensional code, and converts the transmission data into transmission data. is output to the output data restoration unit 44 .
  • the server 4 separates the data obtained by decryption into output data identification information (header and footer) and output data (divided output data) (step S4).
  • the output data restoration unit 44 separates the transmission data received from the two-dimensional code detection unit 421 into a header and a footer, which are output data identification information, and divided output data.
  • the output data identification information is information including information for identifying the output data such as the number of divisions and the data name of the output data (for example, file name).
  • the output data identification information is the header and footer, but the method of adding the output data identification information to the divided output data is not limited to this example.
  • the right side of FIG. 7 shows an example in which the transmission data exemplified in FIG. ing. Since the number of divisions is 1 in this example, the output data after division is equal to the output data.
  • the server 4 restores the output data before division based on the data name and division number (step S5). Specifically, if the number of divisions included in the output data identification information is 1, the output data restoration unit 44 uses the divided output data separated in step S4 as the output data. If the number of divisions included in the output data identification information is two or more, the output data restoration unit 44 generates output data by combining divided output data having the same data name included in the output data identification information. At this time, if the output data identification information includes a division number, the output data restoration unit 44 combines the divided output data in the order of the division number. The output data restoration unit 44 may combine the divided output data based on the information indicating the time as described above.
  • the server 4 saves the output data (step S6).
  • the output data restoring unit 44 stores the output data restored in step S5 in the restored data saving unit 45 .
  • the server 4 can restore the output data stored in the memory 15 of the control device 11 of the machine 1 by performing the processing shown in FIG.
  • the supplementary information is read from the captured image storage unit 41 by a control unit (not shown) that controls the server 4, and is stored in the restored data storage unit 45 in association with the restored data.
  • the response computer 5 can read out the supplementary information and the corresponding output data from the restored data storage unit 45 and remotely diagnose and maintain the machine 1 using the read information.
  • the control device 11 of this embodiment is realized by, for example, a computer system. That is, the computer system functions as the control device 11 by executing a program, which is a computer program in which processing in the control device 11 is described, on the computer system.
  • FIG. 8 is a diagram showing a configuration example of a computer system that implements the control device 11 of this embodiment. As shown in FIG. 8, this computer system comprises a processor 101, a memory 102, a display 103, an input section 104 and a communication section 105, which are connected via, for example, a system bus.
  • the processor 101 is, for example, a CPU (Central Processing Unit), MPU (Micro Processor Unit), etc., and executes a program describing the processing in the control device 11 of the present embodiment.
  • a part of the processor 101 may be implemented by a processing circuit that is dedicated hardware such as an FPGA (Field-Programmable Gate Array).
  • the memory 102 includes various memories such as RAM (Random Access Memory) and ROM (Read Only Memory) and storage devices such as hard disks, and stores programs to be executed by the processor 101, necessary data obtained in the process of processing, etc. to remember.
  • the memory 102 is also used as a temporary storage area for programs.
  • the input unit 104 is composed of, for example, a keyboard, mouse, etc., and is used by the user of the computer system to input various information.
  • the display 103 is composed of a display, LCD (liquid crystal display panel), etc., and displays various screens to the user of the computer system. Note that the input unit 104 and the display device 103 may be integrated and realized by a touch panel.
  • a communication unit 105 is a receiver and a transmitter that perform communication processing. Note that FIG. 8 is an example, and the configuration of the computer system is not limited to the example in FIG.
  • a computer program is installed in the memory 102 from a recording medium, for example, in the computer system having the configuration described above. Then, when the program is executed, the program read from the memory 102 is stored in the main storage area of the memory 102 . In this state, processor 101 executes processing as control device 11 of the present embodiment according to the program stored in memory 102 .
  • a program describing processing in the control device 11 is provided as a recording medium.
  • the recording medium is not limited to this.
  • a program provided via a transmission medium such as the Internet via the communication unit 105 may be used.
  • the diagnostic program of the present embodiment divides the output data used for diagnosis in the control device 11 to generate a plurality of divided data, and each of the plurality of divided data is the identification information of the output data. It generates transmission data to which data identification information and division information indicating the order of division data is added, converts the transmission data into a two-dimensional code, and executes a process of displaying the two-dimensional code.
  • the diagnostic program of the present embodiment receives image data, which is data of an image in which the two-dimensional code displayed on the server 4 is imaged, from the portable information terminal that captured the image, , extracts the two-dimensional code, decodes the extracted two-dimensional code, and uses the data identification information and division information included in the decoded information obtained by decoding to execute the process of restoring the output data from multiple pieces of decoded information.
  • the two-dimensional code generation unit 13 and the transmission data conversion unit 14 shown in FIG. 1 are realized by executing the computer program stored in the memory 102 shown in FIG. 8 by the processor 101 shown in FIG.
  • the memory 102 shown in FIG. 8 is also used to realize the two-dimensional code generator 13 and the transmission data converter 14 shown in FIG.
  • Screen display unit 12 shown in FIG. 1 is implemented by display device 103 and processor 101 shown in FIG.
  • Memory 15 shown in FIG. 1 is part of memory 102 shown in FIG.
  • the mobile information terminal 3 is realized by adding a camera 31 as a photographing device to the computer system with the configuration shown in FIG. 8, for example.
  • the server 4 and the response computer 5 are also realized by the computer system having the configuration shown in FIG. 8, for example.
  • the image analysis unit 42, the two-dimensional code decoding unit 43, and the output data restoration unit 44 shown in FIG. 1 are implemented by executing computer programs stored in the memory 102 shown in FIG. It is realized by The memory 102 shown in FIG. 8 is also used to implement the image analysis unit 42, the two-dimensional code decoding unit 43, and the output data restoration unit 44 shown in FIG.
  • the captured image storage unit 41 and the restored data storage unit 45 shown in FIG. 1 are part of the memory 102 shown in FIG.
  • the server 4 and the correspondence computer 5 may each be realized by a plurality of computer systems.
  • the server 4 and the correspondence computer 5 may each be realized by a cloud computer system.
  • the machine 1 displays the output data inside the machine 1 in one or more two-dimensional codes, and the area containing the two-dimensional code of the machine 1 is displayed by the portable information terminal 3. A photograph is taken and the photographed data is transmitted to the server 4, and the server 4 restores the output data from the photographed data.
  • the output data of the machine 1 can be easily retrieved even when the machine 1 is not provided with an attachment port for an external storage medium and the network connection of the machine 1 is restricted.
  • remote diagnosis and remote maintenance of the machine 1 can be realized while preventing information leakage.
  • the machine 1 divides the output data, generates a two-dimensional code for each divided output data, and the server 4 restores the output data from the two-dimensional code.
  • the amount of diagnostic information that can be presented can be increased.
  • Embodiment 2 Next, the diagnostic system 6 of Embodiment 2 will be described.
  • the configuration of the diagnostic system 6 of the present embodiment and the configuration of each device constituting the diagnostic system 6 are the same as those of the first embodiment.
  • the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.
  • FIG. 9 is a diagram showing an example of the device data output screen of this embodiment.
  • a screen for selecting output data is displayed in the same manner as the device data output screen shown in FIG. there is "LOGDATA.DAT” stores the log of the machine 1, and "LOGDATA.DAT” has a larger amount of information than "SYSTEM.DAT” exemplified in the explanation of the operation in the first embodiment.
  • the output data may be subjected to at least one of compression processing and encryption. In this embodiment, an example will be described in which at least one of compression processing and encryption is applied to output data as conversion processing in the transmission data conversion unit 14 .
  • FIG. 10 is a diagram showing an example of data generated by the transmission data conversion unit 14 and the two-dimensional code generation unit 13 of the control device 11 of this embodiment when compression processing is applied to the output data.
  • FIG. 10 shows an example in which "LOGDATA.DAT" is selected on the device data output screen as shown in FIG.
  • the transmission data conversion unit 14 reads the electronic file "LOGDATA.DAT" from the memory 15 as output data, and compresses the read output data.
  • the transmission data conversion unit 14 divides the compressed output data, which is the compressed output data, in the same manner as in the first embodiment, and outputs the divided data (divided output data) to the two-dimensional code generation unit 13 .
  • the divided output data shown in FIG. 10 is converted output data that has undergone compression processing, which is an example of conversion processing, in the transmission data conversion unit 14 .
  • the transmission data conversion unit 14 generates transmission data by adding a header and a footer to each divided output data, as in the first embodiment.
  • the header has "ZIP", which is information indicating the processing performed in the transmission data conversion unit 14, added after the data name.
  • transmission data #1 to transmission data #3 are generated as transmission data corresponding to "LOGDATA.DAT".
  • the two-dimensional code generation unit 13 converts each of the transmission data #1 to transmission data #3 into two-dimensional codes (divided two-dimensional codes #1 to #3).
  • FIG. 10 shows a state in which each two-dimensional code is displayed as an image.
  • the dimensional code display unit 122 displays the two-dimensional code as an image, the two-dimensional code illustrated in FIG. 10 is displayed.
  • 11 and 12 are diagrams showing an example of a two-dimensional code output screen according to the present embodiment.
  • split two-dimensional codes #1 and #2 are displayed on the same screen page, which is one screen, and split two-dimensional code #3 is displayed on another screen page.
  • 11 and 12 show an example in which two two-dimensional codes are displayed on one screen page, but the number of two-dimensional codes displayed on one screen page is not limited to two. Anything above that is fine.
  • the screen page to be displayed is switched, for example, by pressing "page switching" at the bottom of the two-dimensional code output screen.
  • the displayed two-dimensional code is photographed by the mobile information terminal 3 in the same manner as in the first embodiment, and the mobile information terminal 3 transmits photographed data representing the photographed image to the server 4 .
  • photographed data representing the photographed image
  • supplementary information may be transmitted to the server 4 together with the photographed data.
  • FIG. 13 is a flow chart showing an example of the operation of the server 4 of this embodiment. Steps S1 to S4 are the same as in the first embodiment.
  • the two-dimensional code detection unit 421 cuts out the two two-dimensional codes and sequentially applies them to the two-dimensional code decoding unit 43. Output to
  • step S5a the output data restoration unit 44 combines according to the data name and the number of divisions, inversely transforms (decompresses) according to the transformation method, and restores the output data. Specifically, as in the first embodiment, the output data restoration unit 44 combines divided output data having the same data name, and converts the combined data inversely of the conversion performed by the control device 11. to restore the output data. For example, as described above, when compression processing has been performed, decompression processing is performed as inverse conversion. When encryption is performed in the control device 11, the ciphertext is converted into plaintext by performing decryption as inverse conversion. Step S6 after step S5a is the same as in the first embodiment. Further, when both encryption and compression are performed in the control device 11, inverse conversion of both is performed. Operations of the present embodiment other than those described above are the same as those of the first embodiment.
  • output data is subjected to at least one of compression and encryption, and is displayed in one or more two-dimensional codes as in the first embodiment.
  • the mobile information terminal 3 takes an image of the area containing the two-dimensional code, transmits the imaged data to the server 4, and the server 4 restores the output data from the imaged data.
  • the same effects as in the first embodiment can be obtained, and effects such as increasing the data size that can be represented by one two-dimensional code by compression and preventing information leakage can be obtained.
  • by displaying a plurality of two-dimensional codes on one screen page it is possible to increase the data size of output data that can be transmitted with one image data.
  • FIG. 14 is a diagram illustrating a configuration example of a diagnostic system according to a third embodiment.
  • the diagnostic system 6a of this embodiment is the same as that of the first embodiment except that the machine 1 is replaced with a machine 1a.
  • the machine 1a is the same as the machine 1 of Embodiment 1 except that the controller 11 is replaced with a controller 11a.
  • the control device 11a is the same as the control device 11 of Embodiment 1, except that the transmission data conversion section 14 is replaced with a transmission data conversion section 14a.
  • Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted.
  • the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.
  • the transmission data conversion unit 14a includes a division size adjustment unit 141.
  • the division size adjustment unit 141 determines the data size of the division data corresponding to each of the plurality of two-dimensional codes to be displayed simultaneously, based on the size of the area in which the two-dimensional code can be displayed and the data size of the output data. Specifically, the division size adjustment unit 141 adjusts the size of the two-dimensional code to be displayed on one screen and the number of two-dimensional codes to be displayed on one screen according to the size of the area in which the two-dimensional code can be displayed.
  • the amount of information that can be expressed in the two-dimensional code that is, the amount of information that can be converted into the two-dimensional code increases according to the number of cells used in the two-dimensional code. For this reason, for example, if the size of each cell of the two-dimensional code is determined in advance by how many pixels, the data size that can be converted into the two-dimensional code can be associated with the size of the two-dimensional code.
  • FIG. 15 is a diagram showing an example of the size of the two-dimensional code output screen displayed by the control device 11a of the present embodiment.
  • a two-dimensional code can be displayed in the area 201, and the resolution of the display 103 that implements the machine 1a is 380 points in the vertical direction and 380 points in the horizontal direction. 640pt.
  • FIGS. 16 and 17 are diagrams showing examples of two-dimensional codes displayed by the control device 11 of Embodiment 1.
  • FIG. 16 and 17 are diagrams showing examples of two-dimensional codes displayed by the control device 11 of Embodiment 1.
  • FIG. 16 and 17 a two-dimensional code corresponding to output data with a division number of 2 is generated.
  • the output data is divided for each division size corresponding to the size of the two-dimensional code that can be displayed after securing a certain margin in the top, bottom, left, and right within the area 201. be done.
  • the final divided output data is less than the division size. For this reason, for example, as shown in FIGS. 16 and 17, a two-dimensional code of 356pt ⁇ 356pt is displayed on the first screen page, and 180pt ⁇ 180pt is displayed on the second screen page. In this example, two two-dimensional codes will be displayed over two screen pages.
  • FIG. 18 is a diagram showing an example of a two-dimensional code displayed by the control device 11a of this embodiment.
  • the example shown in FIG. 18 shows an example in which output data having the same size as the output data shown in FIGS. 16 and 17 is divided as two two-dimensional codes. Therefore, in the example shown in FIG. 18, two two-dimensional codes can be displayed on one screen page, and the portable information terminal 3 can photograph two two-dimensional codes at once.
  • the size of the two-dimensional code is determined by the division size adjusting unit 141 so that the number of screen pages on which the two-dimensional code is displayed is reduced, and the two-dimensional code is divided according to the determined two-dimensional code. size is determined.
  • the transmission data conversion unit 14a determines the division size based on the data size of the output data read from the memory 15 so as to reduce the number of screen pages on which the two-dimensional code is displayed.
  • the output data is divided in the same manner as in 1, and transmission data is generated by adding a header and a footer to the divided output data.
  • Operations of the present embodiment other than those described above are the same as those of the first embodiment.
  • the hardware configuration of the control device 11a of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.
  • the transmission data conversion unit 14 of the second embodiment may be provided. That is, the transmission data conversion unit 14 performs at least one of compression and encryption on the output data, and divides the data so that the number of screen pages on which the two-dimensional code is displayed is reduced based on the data size of the processed data. A size may be determined.
  • the division size is determined so that the number of screen pages on which the two-dimensional code is displayed is reduced.
  • the same effect as in the first embodiment can be obtained, and the number of screen pages on which the two-dimensional code is displayed can be reduced, and the number of times the mobile information terminal 3 takes pictures can be reduced.
  • FIG. 19 is a diagram illustrating a configuration example of a diagnostic system according to a fourth embodiment.
  • the diagnostic system 6b of this embodiment is the same as that of the first embodiment except that the machine 1b is replaced with the machine 1b.
  • the machine 1b is the same as the machine 1 of Embodiment 1 except that the controller 11 is replaced with a controller 11b.
  • the control device 11b is the same as the screen display section 12 of the first embodiment except that the screen display section 12a is replaced with the screen display section 12a.
  • the screen display section 12a is the same as the screen display section 12 of the first embodiment except that the device data output section 121 is replaced with a device data output section 121a.
  • the device data output section 121a is the same as the device data output section 121 of the first embodiment except that the two-dimensional code display section 122 is replaced with a two-dimensional code display section 122a.
  • Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted.
  • the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.
  • the two-dimensional code display section 122a includes the automatic page switching section 123.
  • the automatic page switching unit 123 automatically switches the screen page on which the two-dimensional code is displayed.
  • FIG. 20 is a diagram showing an example of screen page display switching and its time chart by the automatic page switching unit 123 of the present embodiment.
  • the automatic page switching unit 123 displays a two-dimensional code corresponding to one piece of output data over a plurality of screen pages, for example, the "automatic switching" at the bottom of the two-dimensional code display screen is set to When pressed, the screen page is automatically switched.
  • the automatic page switching unit 123 sequentially displays, for example, screen pages from page #1 to the final page at switching intervals that are constant times. Further, a repeated display may be performed in which screen pages from page #1 to the final page are repeatedly displayed.
  • repetitive display When repetitive display is performed, after page #1 to the final page are displayed, after a predetermined repetitive display pause interval, display from page #1 to the final page is repeated again. Repeat until instructed to stop or a specified number of times.
  • the repeat display pause interval may be user configurable. The specified number of times may be predetermined or may be set by the user.
  • the mobile information terminal 3 is configured to capture moving images or still images so that all screen pages from page #1 to the final page displayed by automatic switching as described above are captured.
  • a two-dimensional code display screen is photographed by continuous shooting.
  • Shooting data indicating data shot by continuous shooting of moving images or still images includes a plurality of shot images corresponding to different times.
  • Portable information terminal 3 transmits the photographed data to server 4 in the same manner as in the first embodiment.
  • FIG. 21 is a diagram showing an example of a method for extracting a two-dimensional code image when photographed as a moving image according to the present embodiment.
  • the image analysis unit 42 of the server 4 reads the photographed data, which is moving image data, from the photographed image storage unit 41, and cuts out images (image snapshots) for all image pages at image cutout intervals determined from the moving image data.
  • the image clipping interval is determined, for example, as switching interval/N (N is a natural number). Note that when N is 1, the image may not be correctly extracted if the timing for extracting an image from the moving image data coincides with the page switching timing of the two-dimensional code display screen, so N is preferably 2 or more.
  • the present invention is not limited to this, and it is sufficient if the image clipping interval ⁇ (switching interval - time required for updating the image).
  • the time required to update the image is the time required for updating the image when switching the image to be displayed in the control device 11 .
  • the two-dimensional code detection unit 421 of the image analysis unit 42 cuts out a two-dimensional code image from each cut-out image in the same manner as in the first embodiment, and sequentially outputs the cut-out two-dimensional code images to the two-dimensional code decoding unit 43. .
  • the two-dimensional code detection unit 421 compares the two-dimensional codes of the cut out images, and if it determines that the images of the same two-dimensional code are continuous, it detects one image from the same two-dimensional code image. One of them may be selected and output to the two-dimensional code decoding unit 43 . Further, when screen pages are displayed in the screen page display areas 202 to 204 of the two-dimensional code output screen in the same manner as in the examples shown in FIGS. Duplicates may be determined based on 202-204. For example, the image analysis unit 42 detects the screen page display areas 202 to 204 from each clipped image, and detects the numbers indicating the screen pages in the screen page display areas 202 to 204 by image recognition processing.
  • the output data restoration unit 44 at the subsequent stage obtains a plurality of pieces of transmission data in which the page number, which is the division number included in the output identification information in the decoded transmission data, overlaps, the transmission data is selected from a plurality of The output data may be restored using one transmission data.
  • FIG. 22 is a diagram showing an example of a method for extracting a two-dimensional code image when still images are shot continuously according to the present embodiment.
  • the image analysis unit 42 of the server 4 reads the photographed data obtained by continuous shooting from the photographed image storage unit 41, and cuts out each still image from the photographed data.
  • M is a natural number
  • the continuous shooting interval which is the cycle of continuous shooting, is 1/M seconds. is. If the switching interval is too long compared to the continuous shooting interval, the same screen page will be shot many times.
  • the switching interval is short, such as less than one second, it is possible to shorten the shooting time required to shoot a full-screen page and suppress the data size of the shooting data.
  • the cycle of continuous shooting can be set to a natural number fraction of the switching interval.
  • the two-dimensional code detection unit 421 of the image analysis unit 42 cuts out a two-dimensional code image from a plurality of images indicated by a plurality of image data included in the photographed data in the same manner as in the first embodiment, and sequentially extracts the cut-out two-dimensional code image. Output to the two-dimensional code decoding unit 43 .
  • the two-dimensional code detection unit 421 compares the two-dimensional code of each clipped image. One may be selected from the two-dimensional code images and output to the two-dimensional code decoding section 43 .
  • overlap may be determined based on the screen page display areas 202 to 204 and an image may be selected.
  • the page number which is a number, may be used to restore the output data using one transmission data selected from a plurality of transmission data.
  • the two-dimensional code screen on which the control device 11b displays the two-dimensional code is displayed within a certain period of time when the two-dimensional code corresponding to one piece of output data is displayed over a plurality of screen pages. Screen pages are automatically switched at certain switching intervals.
  • the photographed data photographed by the portable information terminal 3 is data of a moving image photographed so as to include a plurality of screen pages, or a plurality of still images photographed by continuous photographing at a cycle equal to a natural number of the switching interval. data.
  • the server 4 extracts images corresponding to a plurality of screen pages from the photographed data using the switching interval, and extracts a two-dimensional code from the extracted images.
  • the photographed data is data representing a plurality of still images photographed by continuous shooting
  • the server 4 extracts images corresponding to a plurality of screen pages from the photographed data using the continuous photographing interval, and extracts the extracted images. Extract the two-dimensional code from
  • control device 11b of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.
  • the two-dimensional code display unit 122 of the second or third embodiment automatically The page switching unit 123 may be provided, and the server 4 may perform the operation of this embodiment.
  • the automatic page switching unit 123 automatically switches screen pages. This eliminates the need for the user to manually switch between screen pages, and the user only needs to use the portable information terminal 3 to shoot moving images or continuous shots. In addition, it is possible to efficiently acquire photographed data.
  • Embodiment 5 Next, the diagnostic system 6 of Embodiment 5 will be described.
  • the configuration of the diagnostic system 6 of the present embodiment and the configuration of each device constituting the diagnostic system 6 are the same as those of the first embodiment.
  • the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.
  • this embodiment an example of converting a plurality of pieces of output data into a two-dimensional code will be described.
  • FIG. 23 is a diagram showing an example of the device data output screen of this embodiment. As with the device data output screen shown in FIG. 2, the device data output screen shown in FIG. 23 displays a screen for selecting output data. DAT" and "PARAMET.DAT" are selected.
  • FIG. 24 is a diagram showing an example of data generated by the transmission data conversion unit 14 and the two-dimensional code generation unit 13 of the control device 11 of this embodiment.
  • the user selects "TOOLDATA.DAT”, “OFFSET.DAT”, and "PARAMET.DAT” as output data as shown in FIG.
  • the transmission data conversion unit 14 divides each output data,
  • the transmission data A to C are generated by adding the output data identification information including the data name of the output data to the divided output data.
  • the number of divisions may be one.
  • the number of divisions of "TOOLDATA.DAT” is two
  • the number of divisions of "OFFSET.DAT” is one
  • the number of divisions of "PARAMET.DAT” is two.
  • the output data may be subjected to conversion processing, which is at least one of compression and encryption.
  • conversion processing which is at least one of compression and encryption.
  • ZIP compression is applied to the output data.
  • the data name of the output data, the number of divisions, the division number, and information indicating the conversion process are added as a header. Note that FIG. 24 is an example, and the conversion processing to be applied to the output data, the number of divisions, and the like are not limited to the example shown in FIG. Also, the output data may not be subjected to conversion processing.
  • the two-dimensional code generation unit 13 receives each transmission data generated by the transmission data conversion unit 14 and generates a corresponding two-dimensional code.
  • two two-dimensional codes A corresponding to output data A, one two-dimensional code B corresponding to output data B, and two two-dimensional codes C corresponding to output data C are generated. be.
  • two two-dimensional codes A are displayed on one screen page
  • two-dimensional code B is displayed on another one-screen page
  • two two-dimensional codes C are displayed on another one-screen page.
  • the information terminal 3 photographs each screen page.
  • the mobile information terminal 3 acquires three shot data corresponding to each screen page, and transmits the three shot data to the server 4 .
  • FIG. 25 is a flow chart showing an example of the operation of the server 4 of this embodiment. Steps S1 to S4 and S6 shown in FIG. 25 are the same as in the first embodiment.
  • the output data restoration unit 44 restores the output data in the same manner as in the first embodiment. based on the order in which they were divided. As a result, output data A to C shown in FIG. 25 can be restored from photographed data obtained by photographing two-dimensional codes A to C shown in FIG. In the example shown in FIG. 24, since the data is compressed by ZIP as described in the second embodiment, the output data restoration unit 44 decompresses the combined output data.
  • control device 11b of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.
  • the diagnostic system 6 of Embodiment 1 or Embodiment 2 has been described as an example, but in the diagnostic system 6a of Embodiment 3 and the diagnostic system 6b of Embodiment 4, a plurality of output data are If selected, similar processing can be performed.
  • output data A to C are compressed, but conversion processing to be performed for each output data may be determined.
  • output data A and C may be compressed, and output data B may not be converted.
  • the content of the conversion process may be determined for each output data, that is, for each type of output data, or may be determined according to the data size of the output data.
  • the machine 1 divides the output data, generates a two-dimensional code for each divided output data, and the server 4 restores the output data from the two-dimensional code.
  • the amount of diagnostic information that can be presented can be increased.
  • FIG. 26 is a diagram illustrating a configuration example of a diagnostic system according to a sixth embodiment
  • a diagnostic system 6c of the present embodiment includes a machine 1c, a Web server 7 that is an example of the server 4 described in the first embodiment, and a response computer 5.
  • the web server 7 has the function of the server 4 described in the first embodiment. Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted.
  • the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.
  • the machine 1c is the same as the control device 11 of Embodiment 1 except that it has a control device 11c instead of the control device 11.
  • the control device 11c is the same as the control device 11 of Embodiment 1 except that a self-diagnostic unit 18 is added.
  • the self-diagnostic unit 18 performs self-diagnosis of the health condition of the machine 1c using the information indicating the state of the machine 1c stored in the memory 15, the machine signal of the machine peripheral device 2, and the like, and displays the self-diagnosis result. It generates diagnostic data and outputs the self-diagnostic data to the transmission data converter 14 .
  • the transmission data converter 14 uses the self-diagnostic data as the output data of the first embodiment to generate transmission data in the same manner as in the first embodiment.
  • the operations of the two-dimensional code generation unit 13 and the screen display unit 12 are the same as those of the first embodiment.
  • the web server 7 has a function of providing information provided as a web page (not shown) to terminals such as the portable information terminal 3a in response to access requests from the terminals.
  • a user who makes an inquiry about the machine 1c or requests a diagnosis operates the mobile information terminal 3a to display information on the Web page on the mobile information terminal 3a.
  • the portable information terminal 3a is the same as the portable information terminal 3 of Embodiment 1, except that an authentication unit 34 is added.
  • the authentication unit 34 performs user authentication processing for using the diagnostic service. For example, the authentication unit 34 transmits a pre-registered user ID (IDentifier: identification information) and password to the Web server 7 in order to use the diagnostic service.
  • the user ID and password may be input to the mobile information terminal 3a by the user, or may be stored in the mobile information terminal 3a. Note that the authentication method is not limited to this example.
  • the user uses the portable information terminal 3a to take a photographed image including the two-dimensional code and acquire photographed data, as in the first embodiment.
  • the user uses the portable information terminal 3a to post post data including photographed data to a user post page, which is a post page dedicated to the user. That is, the mobile information terminal 3a transmits the post data to the web server 7 based on the input from the user.
  • a posting page may be provided for each thread.
  • the web server 7 includes an authentication unit 71, a user posted data management unit 72, a posted data storage unit 73, an image recognition unit 74, a learning data storage unit 75, a data storage unit 76, a message notification unit 77, an image analysis unit 42, two A dimension code decoder 43 and an output data restorer 44 are provided.
  • the image analysis unit 42, the two-dimensional code decoding unit 43 and the output data restoration unit 44 are the same as the image analysis unit 42, the two-dimensional code decoding unit 43 and the output data restoration unit 44 of the server 4 of the first embodiment.
  • Authentication unit 71 performs authentication processing with portable information terminal 3a, and upon receiving posted data transmitted from successfully authenticated portable information terminal 3a, authenticates the posted data together with corresponding user identification information to user posted data management unit. 72.
  • User posted data management portion 72 stores the posted data in posted data storage portion 73 .
  • user posted data management portion 72 notifies message notification portion 77 that the posted data has been posted.
  • the posted data stored in posted data storage portion 73 is managed for each user. Further, when a posting page is provided for each thread, the posted data stored in posted data storage portion 73 may be managed for each thread.
  • the two-dimensional code detection unit 421 of the image analysis unit 42 reads the posted data for each item stored in the posted data storage unit 73, extracts the two-dimensional code image from the photographed data included in the posted data, and extracts the extracted two-dimensional code image.
  • the dimension code image is output to the two-dimensional code decoding section 43 .
  • the two-dimensional code detection unit 421 may extract the two-dimensional code image from the photographed data by the same method as in the first embodiment, but the image recognition result obtained by the image recognition unit 74 shown in FIG. A two-dimensional code image may be extracted.
  • the two-dimensional code detection unit 421 outputs the photographed data to the image recognition unit 74, and the image recognition unit 74 uses the feature amount teaching data stored in the learning data storage unit 75 to convert the photographed data into Each characteristic part is specified from the photographed image shown, the two-dimensional code in the photographed image is recognized using the specified result, and the recognition result is notified to the two-dimensional code detection unit 421 .
  • the image recognition unit 74 recognizes a characteristic portion, which is a predetermined characteristic portion, by pattern recognition or the like.
  • the characteristic parts are, for example, a common frame that is the outer frame of the two-dimensional code display screen, a display frame that is an area in which the two-dimensional code can be displayed, square-shaped parts provided at three corners of the two-dimensional code, and the screen. The part where the page is displayed, etc.
  • Pattern recognition may be performed by machine learning. That is, the image recognition unit 74 recognizes the position of the two-dimensional code in the image represented by the photographed data by machine learning based on the feature amount of the image representing the two-dimensional code, and sends the recognition result to the two-dimensional code detection unit 421. may be output.
  • FIG. 27 is a diagram showing an example of a characteristic portion of the two-dimensional code display screen of this embodiment.
  • the characteristic portions are a characteristic portion F1 which is a common frame of the two-dimensional code output screen, a characteristic portion F2 which is a display frame capable of displaying the two-dimensional code, and three corners of the two-dimensional code.
  • a characteristic portion F3, which is a square-shaped portion where the screen page is displayed, and a characteristic portion F4, which is a portion where the screen page is displayed, are exemplified.
  • the feature amount may be of any type, and may include, for example, line shape, line length, line inclination, color, etc., or may be the image itself.
  • the image recognition unit 74 uses the feature amount teaching data stored in the learning data storage unit 75 to identify each characteristic portion from the photographed image indicated by the photographed data, thereby recognizing the position of the two-dimensional code in the photographed image. Detection accuracy can be improved.
  • the image recognition by the image recognition unit 74 may be performed by machine learning such as supervised learning.
  • a neural network, a support vector machine, or the like can be used as a supervised learning algorithm, but is not limited to these.
  • the image recognition unit 74 includes a learned model generation unit, an inference unit, and a preprocessing unit. do.
  • an image that is not a two-dimensional code is prepared, and the feature amount is calculated from the image.
  • the trained model generation unit uses the calculated feature amount as input data, sets the input data and information indicating whether or not it is a two-dimensional code image as the corresponding correct data as a learning data set, and creates a learning data set.
  • the preprocessing unit cuts out a part of the photographed image represented by the photographed data, extracts the feature amount from the cut out image, and the inference unit By inputting the feature amount into the learned model stored in the learning data storage unit 75, it is inferred whether or not the input image is the image of the two-dimensional code.
  • the inference unit can obtain a cut out image that is inferred to be the image of the two-dimensional code. Note that even if the image recognition unit 74 does not include a trained model generation unit, a learning device that generates a trained model is separately provided, and the trained model generated by the learning device is stored in the learning data storage unit 75. good.
  • the two-dimensional code decoding unit 43 and the output data restoring unit 44 perform the same processing as in the first embodiment.
  • the output data restoring unit 44 stores the restored output data in the restored data saving unit 45 in the data storage unit 76 on a case-by-case basis.
  • Information other than the photographed data in the posted data is read from the posted data storage unit 73 by a control unit (not shown) that controls the web server 7, and stored in the data storage unit 76 in association with the restored data. be.
  • the message notification unit 77 When the message notification unit 77 is notified of the posting, it notifies the response computer 5 of the posting. Further, the message notification unit 77 transmits a later-described reply to the posting from the reception computer 5 to the portable information terminal 3a. In addition, the message notification unit 77 may notify the operator of the posting by transmitting the message to a terminal (not shown) of the operator.
  • the response computer 5 includes a diagnostic information storage unit 51 , an AI (Artificial Intelligence) bot 52 and an answer transmission unit 53 .
  • the response computer 5 of Embodiments 1 to 5 may be the same as the response computer 5 of the present embodiment, or may have a different configuration from the response computer 5 of the present embodiment.
  • the diagnostic information storage unit 51 stores device diagnostic information for diagnosing the machine 1c.
  • the device diagnostic information may be stored in the diagnostic information storage unit 51 as, for example, a device diagnostic DB (DataBase).
  • the device diagnosis information includes, for example, an analysis flowchart for obtaining a primary diagnosis result according to the content of the output data, an analysis flowchart for performing a secondary diagnosis based on the primary diagnosis result, and a coping method based on the primary diagnosis result (inspection points, inspection methods, direct inquiries, etc.).
  • the device diagnostic information may include an image, a document, or the like for explaining inspection points, inspection methods, and the like.
  • AI bot 52 which is an automatic conversation unit, it outputs information indicating a predetermined primary response to answer transmission unit 53, and restores the restored data in data storage unit 76 of Web server 7.
  • Output data is acquired from the storage unit 45 on a case-by-case basis.
  • AI bot 52 uses the obtained output data and the device diagnostic information stored in diagnostic information storage unit 51 to generate an answer to the post, and outputs the generated answer to answer transmission unit 53 .
  • the AI bot 52 performs a primary diagnosis using the acquired output data and the device diagnostic information stored in the diagnostic information storage unit 51, and generates a response including the primary diagnostic result and coping methods.
  • the response and the device diagnostic information stored in the diagnostic information storage unit 51 are used to A secondary diagnosis is performed, and an answer including the secondary diagnosis result and coping method is generated.
  • the method of calculating the diagnosis result by the AI bot 52 is not limited to this.
  • the operator may respond to the post when the operator is present, and the AI bot 52 may respond when the operator is absent.
  • the operator may prepare a response using a paper manual or the like.
  • the response transmission unit 53 transmits the response received from the AI bot 52 to the web server 7.
  • User posted data management section 72 of Web server 7 outputs the reply transmitted from reply transmission section 53 to message notification section 77 .
  • the message notification unit 77 transmits the reply received from the user posted data management unit 72 to the mobile information terminal 3a.
  • FIG. 28 is a diagram showing an example of diagnosis in the diagnostic system 6c of this embodiment.
  • a user contribution page screen 301 is displayed on the mobile information terminal 3a.
  • a user of the machine 1c posts by operating the portable information terminal 3a.
  • the user inputs a message indicating that an alarm xx has occurred, and together with this message, the photographed data obtained by photographing the two-dimensional code corresponding to the self-diagnostic data of the machine 1c is the posted data.
  • a two-dimensional code corresponding to other output data may be generated together with the self-diagnostic data, and photographed data obtained by photographing the two-dimensional code may be transmitted as posted data.
  • Self-diagnosis data which is output data
  • the image analysis unit 42 the two-dimensional code decoding unit 43, and the output data restoration unit 44 using the photographed data included in the posted data stored in the posted data storage unit 73.
  • the message notification unit 77 notifies the AI bot 52 and the operator that the posted data has been posted, and the AI bot 52 or the operator makes a primary response.
  • the primary response of the AI bot 52 is transmitted to the mobile information terminal 3a via the web server 7 as described above.
  • the message "accepted" is displayed as the primary response.
  • the AI bot 52 performs a primary diagnosis using the self-diagnosis data and the device diagnosis DB, and transmits a coping method corresponding to the primary diagnosis result to the mobile information terminal 3a as a secondary response.
  • the secondary response of the AI bot 52 is also transmitted to the mobile information terminal 3a via the web server 7.
  • FIG. The primary diagnosis result of the AI bot 52 may be transmitted to the operator's terminal or the like, and the operator may transmit the secondary response from the terminal or the like to the mobile information terminal 3a.
  • a primary diagnosis result, a coping method, and an image corresponding to the coping method are displayed as secondary responses.
  • FIG. 28 is an example, and the specific response content is not limited to the example shown in FIG. Also, in FIG. 26, the response from the AI bot 52 is transmitted via the web server 7, but it may be transmitted from the reception computer 5 to the mobile information terminal 3a.
  • control device 11c of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.
  • Web server 7 of this embodiment also has the same hardware configuration as the server 4 of the first embodiment.
  • the mobile information terminal 3a captures the two-dimensional code corresponding to the output data of the machine 1c, and uploads the captured data to the user contribution page managed by the web server 7. Post. Since the Web server 7 restores the output data from the photographed data, even if the computer 5 needs to acquire a plurality of types of information for diagnosis, the computer 5 can respond to the post. Corresponding output data can be easily verified. In addition, the response computer 5 reads out the output data of the machine 1c from the Web server 7 and performs diagnosis using the output data, so that the operator can remotely diagnose and maintain the machine 1c without going to the place where the machine 1c is installed. be able to.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Facsimiles In General (AREA)

Abstract

Un système de diagnostic (6) selon la présente invention comprend un dispositif de commande (11) et un serveur (4). Le dispositif de commande (11) : commande une machine (1) ; génère une pluralité d'éléments de données divisées par division de données de sortie à utiliser pour le diagnostic et/ou la réparation de la machine (1) ; génère des données de transmission obtenues par ajout d'informations d'identification de données concernant les données de sortie et d'informations de division, qui indiquent l'ordre des données divisées, à chaque élément de la pluralité d'éléments de données divisées ; convertit les données de transmission en un code bidimensionnel ; et affiche le code bidimensionnel. Le serveur (4) : reçoit, d'un terminal d'information qui a capturé une image, des données photographiques d'une image capturée du code bidimensionnel affiché ; extrait le code bidimensionnel à partir des données photographiques ; décode le code bidimensionnel extrait ; et récupère, à partir d'une pluralité d'éléments d'informations décodées obtenues par décodage, les données de sortie à l'aide des informations d'identification de données et des informations de division incluses dans les informations décodées.
PCT/JP2022/009183 2022-03-03 2022-03-03 Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic WO2023166672A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2022568955A JP7461510B2 (ja) 2022-03-03 2022-03-03 診断システム、制御装置、診断方法および診断プログラム
PCT/JP2022/009183 WO2023166672A1 (fr) 2022-03-03 2022-03-03 Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/009183 WO2023166672A1 (fr) 2022-03-03 2022-03-03 Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic

Publications (1)

Publication Number Publication Date
WO2023166672A1 true WO2023166672A1 (fr) 2023-09-07

Family

ID=87883343

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/009183 WO2023166672A1 (fr) 2022-03-03 2022-03-03 Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic

Country Status (2)

Country Link
JP (1) JP7461510B2 (fr)
WO (1) WO2023166672A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004265317A (ja) * 2003-03-04 2004-09-24 Daikin Ind Ltd 設備機器及びその故障診断システム
JP2006139349A (ja) * 2004-11-10 2006-06-01 Nikon Corp 情報伝送装置、情報受信装置および情報送信装置
JP2012113365A (ja) * 2010-11-19 2012-06-14 Mitsubishi Electric Corp 設備操作端末、情報処理端末及びそのプログラム、並びに設備管理システム
JP2015169952A (ja) * 2014-03-04 2015-09-28 セイコーエプソン株式会社 通信システム、撮像装置、プログラムおよび通信方法
US20200402280A1 (en) * 2019-06-24 2020-12-24 Realwear, Inc. Photo redaction security system and related methods
JP2021184141A (ja) * 2020-05-21 2021-12-02 国立大学法人 鹿児島大学 コード復号装置、コード復号方法及びプログラム

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6380095B2 (ja) 2014-12-26 2018-08-29 株式会社デンソーウェーブ 携帯型情報コード表示装置
JP7304256B2 (ja) 2019-09-30 2023-07-06 横河電機株式会社 測定器、データ送出機、データ受取機、データ送受システム、及びプログラム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004265317A (ja) * 2003-03-04 2004-09-24 Daikin Ind Ltd 設備機器及びその故障診断システム
JP2006139349A (ja) * 2004-11-10 2006-06-01 Nikon Corp 情報伝送装置、情報受信装置および情報送信装置
JP2012113365A (ja) * 2010-11-19 2012-06-14 Mitsubishi Electric Corp 設備操作端末、情報処理端末及びそのプログラム、並びに設備管理システム
JP2015169952A (ja) * 2014-03-04 2015-09-28 セイコーエプソン株式会社 通信システム、撮像装置、プログラムおよび通信方法
US20200402280A1 (en) * 2019-06-24 2020-12-24 Realwear, Inc. Photo redaction security system and related methods
JP2021184141A (ja) * 2020-05-21 2021-12-02 国立大学法人 鹿児島大学 コード復号装置、コード復号方法及びプログラム

Also Published As

Publication number Publication date
JPWO2023166672A1 (fr) 2023-09-07
JP7461510B2 (ja) 2024-04-03

Similar Documents

Publication Publication Date Title
US20060106508A1 (en) Remote display of diagnostic data apparatus and method
US20130115923A1 (en) Method and system for delivering device specific service documentation to a mobile platform
CN106339194B (zh) 一种用于多设备之间的显示效果的动态调整方法及系统
JPH08129634A (ja) Ｉｄカード及びｉｄカード読取装置
US20140354758A1 (en) System and method for remote notarization and recording digital notary logbook entries
JP2017002898A (ja) 真空装置の遠隔診断
WO2023166672A1 (fr) Système de diagnostic, dispositif de commande, procédé de diagnostic et programme de diagnostic
JP6354253B2 (ja) 画像処理装置、画像処理システム、画像処理方法、及び画像処理プログラム
JP2008123150A (ja) 障害復旧支援装置及び方法並びにプログラム
CN112162718A (zh) 反向交互方法、装置、设备及存储介质
JPWO2020166549A1 (ja) 動的二次元コード評価方法、動的二次元コード評価システム、及び動的二次元コード評価プログラム
JP4701093B2 (ja) 画像処理装置、監視センタ、監視システム、画像処理方法、および画像処理プログラム
WO2021125268A1 (fr) Dispositif de commande, procédé de commande et programme
WO2018167973A1 (fr) Dispositif de capture d'image, procédé de commande et programme de commande
JP2018055594A (ja) 出力情報読み取りシステム及び出力情報読み取り方法
CN110971568A (zh) 一种封闭系统数据对接装置及方法
JP4712629B2 (ja) 設備仕様入力装置
CN105991863A (zh) 图像处理方法和图像处理装置
CN209881936U (zh) 数据传输系统
KR20210034298A (ko) 장비 원격 진단 시스템
KR100399016B1 (ko) 아이엠티-2000을 통한 문서인식/음성낭독방법
CN115205952B (zh) 一种基于深度学习的线上学习图像采集方法及系统
WO2022114180A1 (fr) Procédé et système de génération d'un groupe de codes bidimensionnels dynamiques
JP7370011B2 (ja) 位置管理システム、位置管理システムの集計部、位置管理システムにおける携帯端末が実行する画像情報送信プログラム
JP2019091373A (ja) 書類解析システム、書類解析用携帯端末及び書類解析携帯端末用プログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2022568955

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22929817

Country of ref document: EP

Kind code of ref document: A1