WO2023166672A1

WO2023166672A1 - Diagnosis system, control device, diagnosis method, and diagnosis program

Info

Publication number: WO2023166672A1
Application number: PCT/JP2022/009183
Authority: WO
Inventors: 喜範山田
Original assignee: 三菱電機株式会社
Priority date: 2022-03-03
Filing date: 2022-03-03
Publication date: 2023-09-07
Also published as: JPWO2023166672A1; JP7461510B2

Abstract

A diagnosis system (6) according to the present disclosure comprises a control device (11) and a server (4). The control device (11): controls a machine (1); generates a plurality of pieces of divided data by dividing output data to be used for at least one of the diagnosis or repair of the machine (1); generates transmission data obtained by adding data identification information about the output data and division information, which indicates the order of the divided data, to each of the plurality of pieces of divided data; converts the transmission data to a two-dimensional code; and displays the two-dimensional code. The server (4): receives, from an information terminal that has captured an image, photographic data of a captured image of the displayed two-dimensional code; extracts the two-dimensional code from the photographic data; decodes the extracted two-dimensional code; and recovers, from a plurality of pieces of decoded information obtained through decoding, the output data by using the data identification information and the division information included in the decoded information.

Description

Diagnostic system, controller, diagnostic method and diagnostic program

The present disclosure relates to a diagnostic system, control device, diagnostic method, and diagnostic program for diagnosing a machine.

For example, in machines used as factory production equipment such as NC (Numerical Control) machine tools, memory cards, USB (Universal Serial Bus) In some cases, data output from the machine to the outside is prevented by not providing an insertion slot for an external storage medium such as memory and by limiting the connection to the communication network. Further, for example, when a sealed structure is required due to circumstances of the environment in which the machine is used, there are cases in which a loading port for an external storage medium is not provided and wired network connection is restricted. When diagnosing or maintaining such a machine, it is difficult to remotely know the state of the machine and the parts that make up the machine, because the means for extracting information from the machine is limited.

As a technique for presenting device information to the outside for failure diagnosis and maintenance without using an external storage medium or communication, Patent Document 1 discloses information stored in a device's information storage memory as a two-dimensional code. A technique for saving the user's trouble by doing so has been disclosed.

JP 2013-101367 A

In the technique described in Patent Document 1, a two-dimensional code is used to present diagnostic information for failure diagnosis and maintenance. There may be a shortage of information for this purpose. Therefore, it is desirable to increase the amount of diagnostic information that can be presented.

The present disclosure has been made in view of the above, and aims to obtain a diagnostic system capable of increasing the amount of diagnostic information that can be presented.

In order to solve the above-described problems and achieve the object, a diagnostic system according to the present disclosure controls a machine and divides output data used for at least one of machine diagnosis and maintenance to obtain a plurality of divided data. is added to each of the plurality of divided data to generate transmission data by adding data identification information, which is identification information of the output data, and division information indicating the order of the divided data, and converts the transmission data into a two-dimensional code. , a control device that displays a two-dimensional code, and the photographed data, which is data of an image in which the displayed two-dimensional code is photographed, is received from the information terminal that photographed the image, and the two-dimensional code is extracted from the photographed data. and a server that decodes the extracted two-dimensional code and restores output data from a plurality of pieces of decoded information using data identification information and division information included in the decoded information obtained by decoding.

The diagnostic system according to the present disclosure has the effect of increasing the amount of diagnostic information that can be presented.

1 is a diagram showing a configuration example of a diagnostic system according to a first embodiment; FIG. A diagram showing an example of a device data output screen according to the first embodiment. A diagram showing an example of a two-dimensional code display screen according to Embodiment 1 FIG. 4 is a diagram showing an example of data generated by a transmission data conversion unit and a two-dimensional code generation unit of the control device according to Embodiment 1; FIG. 4 is a diagram showing an example of a photographed image taken by the mobile information terminal of Embodiment 1; A diagram showing an example of a two-dimensional code according to Embodiment 1 4 is a flowchart showing an example of the operation of the server according to the first embodiment; 1 is a diagram showing a configuration example of a computer system that implements the control device of Embodiment 1; FIG. A diagram showing an example of a device data output screen according to the second embodiment FIG. 11 is a diagram showing an example of data generated by the transmission data conversion unit and the two-dimensional code generation unit of the control device according to the second embodiment when compression processing is applied to the output data; A diagram showing an example of a two-dimensional code output screen according to the second embodiment. A diagram showing an example of a two-dimensional code output screen according to the second embodiment. Flowchart showing an example of the operation of the server according to the second embodiment The figure which shows the structural example of the diagnostic system concerning Embodiment 3. FIG. 11 is a diagram showing an example of the size of a two-dimensional code output screen displayed by the control device according to the third embodiment; FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1; FIG. 4 is a diagram showing an example of a two-dimensional code displayed by the control device according to Embodiment 1; A diagram showing an example of a two-dimensional code displayed by the control device according to the third embodiment The figure which shows the structural example of the diagnostic system concerning Embodiment 4. FIG. 11 is a diagram showing an example of screen page display switching and its time chart by the automatic page switching unit of Embodiment 4; FIG. 11 is a diagram showing an example of a method for extracting a two-dimensional code image captured as a moving image according to the fourth embodiment; FIG. 11 is a diagram showing an example of a method for extracting a two-dimensional code image when still images are shot continuously according to the fourth embodiment; A diagram showing an example of a device data output screen according to the fifth embodiment FIG. 12 is a diagram showing an example of data generated by a transmission data conversion unit and a two-dimensional code generation unit of a control device according to Embodiment 5; Flowchart showing an example of the operation of the server according to the fifth embodiment The figure which shows the structural example of the diagnostic system concerning Embodiment 6. A diagram showing an example of a characteristic portion of the two-dimensional code display screen of Embodiment 6 A diagram showing an example of diagnosis in the diagnosis system according to the sixth embodiment.

The diagnostic system, control device, diagnostic method, and diagnostic program according to the embodiment will be described in detail below with reference to the drawings.

Embodiment 1.
1 is a diagram illustrating a configuration example of a diagnostic system according to a first embodiment; FIG. The diagnostic system 6 of this embodiment comprises a machine 1 , a server 4 and a response computer 5 . The machine 1 of this embodiment displays a two-dimensional code indicating diagnostic information that is used for at least one of diagnosing the state of the machine 1 and maintenance of the machine 1 . The user of the machine 1 takes a picture of the area containing the two-dimensional code with the portable information terminal 3, which is an example of an information terminal, and the photographed image is transmitted from the portable information terminal 3 to the server 4. FIG. The server 4 acquires diagnostic information from the two-dimensional code and outputs the acquired diagnostic information to the reception computer 5 . The response computer 5 performs diagnosis and maintenance using the diagnostic information, and presents the diagnostic results to the user. Server 4 and response computer 5 constitute a diagnostic device. In FIG. 1, the server 4 and the reception computer 5 are separately provided, but a diagnostic device in which these are integrated may be provided. Also, the portable information terminal 3 may be included in the diagnostic system 6 .

In this embodiment, since the machine 1 displays the diagnostic information for diagnosing the state of the machine 1 in a two-dimensional code, the machine 1 is not provided with an attachment port for an external storage medium. Diagnostic information of the machine 1 can be sent to the server 4 even if there are restrictions. As a result, the diagnostic system 6 of the present embodiment can perform remote diagnosis and remote maintenance of the machine 1, eliminating the need for a specialized engineer to visit the place where the equipment is installed to perform maintenance.

On the other hand, 2D codes limit the amount of information that can be converted, so the amount of information presented may be insufficient. Therefore, in the present embodiment, the machine 1 can divide the diagnostic information and convert each of the divided diagnostic information into a two-dimensional code. As a result, the machine 1 can increase the amount of diagnostic information that can be presented as compared to when division is not performed. If the diagnostic information to be presented can be represented by one two-dimensional code, the diagnostic information need not be divided. That is, the number of divisions when dividing diagnostic information may be one.

Next, a configuration example of each device will be explained. As shown in FIG. 1, the machine 1 comprises a controller 11 , a drive 16 and a machine signal processor 17 . The machine 1 is, for example, a machine tool that performs machining by numerical control, but is not limited to this.

The driving device 16 drives a motor (not shown) of the machine 1. The mechanical signal processing device 17 exchanges mechanical signals with the mechanical peripheral device 2 . The control device 11 controls the operation of the machine 1 and the machine peripherals 2 by controlling the driving device 16 and the machine signal processing device 17 . The machine peripheral device 2 is, for example, an operation panel for controlling the machine 1, or a device that is standardly mounted on the machine 1 or connected to the machine 1 and controlled by a machine signal from the control device 11, but is limited to these. not. The machine signals acquired by the control device 11 include, for example, signals indicating input contents according to operations using an operation panel, signals from sensors attached to the machine 1 for detecting the state of the machine 1, and machine peripheral devices. 2 state signals, etc., but not limited to these.

The control device 11 includes a screen display unit 12, a two-dimensional code generation unit 13, a transmission data conversion unit 14, and a memory 15. Memory 15 stores the output data. The output data includes diagnostic information used for diagnosing and/or maintaining machine 1 . The output data includes, for example, information indicating the state of the control device 11, operation history information (log) in the drive device 16, information indicating the state of the drive device 16, and mechanical signals acquired by the mechanical signal processing device 17 from the machine peripheral device 2. etc., but not limited to these. The memory 15 also stores system information of the machine 1 and the like. The system information includes, for example, model names and identification information (manufacturing number, etc.) of the machine 1 and the control device 11, information on components of the device system (system specifications), status information on connected sensors and system components, and the like. Including but not limited to. FIG. 1 is an example, and the diagnostic information in the machine 1 is not limited to the control information of the driving device 16, the machine signal acquired from the machine peripheral device 2, and the like.

The transmission data conversion unit 14 divides the output data to generate a plurality of divided data, and each of the plurality of divided data includes data identification information that is identification information of the output data and division information that indicates the order of the divided data. Add Specifically, the transmission data conversion unit 14 reads the output data stored in the memory 15 of the control device 11 , divides the read output data, and transmits the divided output data to the server 4 . converts to transmission data in the format defined between For example, the transmission data conversion unit 14 adds a header and a footer, which will be described later, to the divided output data. The header includes, for example, a data name, which is an example of data identification information. Also, the header may include information indicating the number of divisions, which is an example of division information, and a division number, which is an example of division information indicating the order of the divided output data. For example, the transmission data conversion unit 14 divides the output data into each division size, which is a predetermined data size. Examples are not limiting. The division size is, for example, the size obtained by subtracting the data size of the header and footer from the maximum data size of the output data stored in one two-dimensional code. The transmission data conversion unit 14 determines the number of divisions, for example, based on the quotient obtained by dividing the data size of the output data by the division size. If the output data size is divisible by the division size, the quotient is the number of divisions. If the output data size is not divisible by the division size, the quotient plus 1 is the division number. number.

The two-dimensional code generation unit 13 generates a two-dimensional code by converting the transmission data received from the transmission data conversion unit 14 into a two-dimensional code, and outputs the two-dimensional code to the screen display unit 12.

The screen display unit 12 has a device data output unit 121 , and the device data output unit 121 has a two-dimensional code display unit 122 . The device data output unit 121 generates a device data output screen, which is a screen displayed when the output data of the machine 1 is output to the outside, and displays the generated device data output screen. The device data output screen will be described later. The two-dimensional code display unit 122 displays the two-dimensional code generated by the two-dimensional code generation unit 13 as an image. As a result, the output data stored in the memory 15 is displayed as a two-dimensional code. Although an example in which the output data includes diagnostic information for diagnosing the state of the machine 1 is described here, the information displayed by the machine 1 as a two-dimensional code is not limited to this example.

FIG. 2 is a diagram showing an example of the device data output screen of this embodiment. In the example shown in FIG. 2, data A indicates the output data, that is, the type of output data or the data name of the output data, and data B indicates the output destination. Although the data name of the output data is the file name of the electronic file here, the data name is not limited to this example. In the example shown in FIG. 2, data to be output from each output data displayed as data A is selected by a user's operation using input means (not shown in FIG. 1). After that, the user presses the "Transfer A→B" portion at the bottom of the device data output screen of FIG. Note that the screen display unit 12 may be realized by using a display integrated with input means such as a touch panel, for example. , the data selected by data A is output.

In the example shown in FIG. 2, "SYSTEM.DAT", which is an electronic file in which system information of the control device 11 is stored, is selected as output data, that is, data A. For example, in a machine capable of outputting to an external storage medium such as an SD memory card, the external storage medium can be specified as the transfer destination data B on the device data output screen. cannot be output to an external storage medium.

In this embodiment, when "Transfer A→B" is pressed by the user, a two-dimensional code indicating the selected output data, that is, a two-dimensional code obtained by converting the output data is displayed. FIG. 3 is a diagram showing an example of a two-dimensional code display screen according to the present embodiment. In the example shown in FIG. 3, a QR (Quick Response) code (registered trademark) indicating output data is displayed as an example of a two-dimensional code. The user takes an image of the displayed area including the two-dimensional code using the mobile information terminal 3 and causes the mobile information terminal 3 to transmit data including the image obtained by taking the image to the server 4 . Thereby, the mobile information terminal 3 can transmit the output data of the machine 1 to the server 4 .

Return to the description of Figure 1. As shown in FIG. 1 , the mobile information terminal 3 includes a camera 31 , a captured image memory 32 and a network communication section 33 . The camera 31 captures an image, and stores captured image data representing a captured image in a captured image memory 32 . The network communication unit 33 transmits the photographed data stored in the photographed image memory 32 to the server 4 by wireless communication, for example. The communication line between the network communication unit 33 and the server 4 may be wired or wireless, or may be a mixture of wired and wireless. In FIG. 1, a dashed arrow pointing from the two-dimensional code display unit 122 to the camera 31 is shown. It means being photographed.

The server 4 includes a captured image storage unit 41 , an image analysis unit 42 , a two-dimensional code decoding unit 43 , an output data restoration unit 44 and a restoration data storage unit 45 . The server 4 receives, from the portable information terminal 3, photographed data, which is image data obtained by photographing the displayed two-dimensional code, through a communication unit (not shown in FIG. 1). The received photographed data is stored in the photographed image storage unit 41 .

The image analysis unit 42 includes a two-dimensional code detection unit 421. A two-dimensional code detection unit 421 extracts a two-dimensional code from the photographed data. Specifically, the two-dimensional code detection unit 421 reads the photographed data received from the portable information terminal 3 from the photographed image storage unit 41 on a case-by-item basis, and uses the read photographed data to correspond to the two-dimensional code from the photographed image. The image is cut out as a two-dimensional code, and the cut-out two-dimensional code is output to the two-dimensional code decoding section 43 . A case is a unit in which the user transmits information to the response computer 5 in order to make an inquiry to the response computer 5 or to request a diagnosis to the response computer 5. Equivalent to output data before execution. For example, in the example shown in FIG. 2, output data is selected as data A in units of electronic files, so this electronic file corresponds to one case.

The two-dimensional code decoding unit 43 decodes the two-dimensional code extracted from the photographed data. Specifically, the two-dimensional code decoding unit 43 decodes the two-dimensional code received from the image analysis unit 42 and outputs decoded information, which is the decoding result, to the output data restoration unit 44 . As a result, transmission data converted into a two-dimensional code by the two-dimensional code generator 13 of the control device 11 of the machine 1 is obtained.

The output data restoration unit 44 restores output data from a plurality of pieces of decryption information using data identification information and division information included in the decryption information obtained by decryption. Specifically, the output data restoring unit 44 restores the output data using the decoding result obtained by decoding the two-dimensional code, and stores the restored output data in the restored data storage unit 45 . If the control device 11 of the machine 1 includes a division number in the transmission data, the transmission data is restored by linking the divided output data in the order of the division number. Further, the division information is not limited to the division number, and may be information indicating the time. The output data may be restored by concatenating. The information indicating the time is, for example, the reception time (receiving date and time) of the photographed data or the photographing time (photographing date and time) of the photographed data. For example, information indicating time is added to the photographed data, and the output data restoration unit 44 acquires information indicating time from the image analysis unit 42 via the two-dimensional code decoding unit 43 . Further, when a plurality of two-dimensional codes are included in one screen page, the output data restoration unit 44 determines the division order based on the arrangement positions of the plurality of two-dimensional codes in addition to the information indicating the time. You may For example, the output data restoration unit 44 acquires information about the arrangement position of the two-dimensional code from the image analysis unit 42 via the two-dimensional code decoding unit 43, and the leftmost two-dimensional code has the smallest division number, and the rightmost two-dimensional code has the smallest division number. It may be determined that the division number increases as the number increases.

The response computer 5 reads the output data from the restored data storage unit 45 of the server 4, and obtains information indicating the state of the control device 11, operation history information (log) in the drive device 16, and the state of the drive device 16, which are included in the output data. and the machine signal acquired from the machine peripheral device 2 by the machine signal processing device 17, the state of the machine 1 is diagnosed.

Next, the operation of this embodiment will be described. FIG. 4 is a diagram showing an example of data generated by transmission data conversion section 14 and two-dimensional code generation section 13 of control device 11 of the present embodiment. In the example shown in FIG. 4, it is assumed that the processing performed by the transmission data conversion unit 14 is addition of a header and a footer, and the number of divisions is one. FIG. 4 also shows an example in which the user selects "SYSTEM.DAT" as output data, as illustrated in FIG.

As shown in FIG. 4, the transmission data conversion unit 14 reads the electronic file "SYSTEM.DAT" from the memory 15 as output data, and adds a header (transmission header) and a footer (transmission footer) to the read output data. and output to the two-dimensional code generation unit 13 . In the example shown in FIG. 4, the footer includes the file name "SYSTEM.DAT", which is the identification information of the output data, and a numerical value indicating the page number. In the example shown in FIG. 4, the header and footer are tags indicating the document structure. <SYSTEM. DAT> and </SYSTEM.DAT> as a footer at the end of "SYSTEM.DAT". DAT> is added. In the example shown in FIG. 4, the number of divisions is indicated by "PAGES", and "PAGES=1" indicates that the number of divisions is 1, that is, no division is made. In the example shown in FIG. 4, the division number indicating the divided output data after division is indicated by the page number, <P1> indicates the start position of the first page, and </P1>. indicates the end position of the first page. <BODY> indicates the start position of the output data, that is, the end position of the header, and </BODY> indicates the end position of the output data, that is, the start position of the footer. The format of the transmission data shown in FIG. 4 is an example, and the specific contents of the header and footer are not limited to this example. Further, as described above, the transmission data conversion unit 14 may perform processing other than adding headers and footers to the output data.

The two-dimensional code generation unit 13 converts the transmission data generated by the transmission data conversion unit 14 into a two-dimensional code, as shown in FIG. Note that FIG. 4 shows a state in which the two-dimensional code is displayed as an image. When the two-dimensional code display unit 122 displays the two-dimensional code as an image, the two-dimensional code illustrated in FIG. 4 is displayed.

The user takes an image of the two-dimensional code displayed on the control device 11 using the mobile information terminal 3 . For example, when a problem occurs in the machine 1 or there is a point of concern about the operation of the machine 1 , the user makes an inquiry about the machine 1 to the reception computer 5 or requests a diagnosis. At this time, the user first displays the device data output screen shown in FIG. 2, and selects output data while the device data output screen is displayed. Which output data to select may be determined according to the contents of the diagnosis, or may be instructed from the response computer 5 . When the user selects the output data and presses "Transfer A→B", the process illustrated in FIG. 4 is performed to display the two-dimensional code.

FIG. 5 is a diagram showing an example of a photographed image taken by the mobile information terminal 3 of this embodiment. When photographing is performed using the camera 31 of the mobile information terminal 3, the two-dimensional code and two At least one of tilt and deformation may occur in the portion displayed around the dimension code. In the example shown in FIG. 5, the two-dimensional code in the captured image is tilted.

The portable information terminal 3 transmits the captured image to the server 4. At this time, supplementary information may be transmitted to the server 4 together with the photographed data representing the photographed image. The supplementary information is input to the mobile information terminal 3 by, for example, the user operating input means (not shown). The supplementary information includes, for example, the subject of each inquiry or diagnosis request. Supplemental information may further include text notes of the content of the inquiry, documents for supplementary explanation, images, audio files, and the like. In some cases, the above-mentioned image obtained by photographing the two-dimensional code includes not only the two-dimensional code but also an image of information indicating supplementary explanation. In this case, the photographed image transmitted from the portable information terminal 3 contains both the two-dimensional code and the information indicating the supplemental explanation. The server 4 stores the photographed data received from the portable information terminal 3 in the photographed image storage unit 41 . When the supplementary information is transmitted together with the photographed data, the server 4 stores the supplementary information in the photographed image storage unit 41 in association with the photographed data.

FIG. 6 is a diagram showing an example of the two-dimensional code of this embodiment. FIG. 6 shows a QR code as an example of a two-dimensional code. In the QR code, as shown in FIG. 6, square shapes are arranged at three of the four corners. By detecting three points per piece, the position, size, direction, and inclination of the QR code included in the image can be detected.

FIG. 7 is a flow chart showing an example of the operation of the server 4 of this embodiment. As shown in FIG. 7, the server 4 extracts the two-dimensional code in the image from the feature amount of the two-dimensional code (step S1). Specifically, the two-dimensional code detection unit 421 of the image analysis unit 42 reads the photographed data from the photographed image storage unit 41, extracts the feature amount of the two-dimensional code from the photographed image indicated by the read photographed data, and extracts the feature amount. is used to extract a region corresponding to the two-dimensional code in the photographed image. The feature amount is, for example, the shape of three squares shown in FIG.

Next, the server 4 cuts out the two-dimensional code image included in the image (step S2). Specifically, the two-dimensional code detection unit 421 of the image analysis unit 42 cuts out the image of the area corresponding to the two-dimensional code extracted in step S1 as a two-dimensional code image, and decodes the cut-out two-dimensional code image. Output to the unit 43 . The two-dimensional code detection unit 421 sequentially performs the processes of steps S1 and S2 on each shot data stored in the shot image storage unit 41 .

Next, the server 4 decodes the two-dimensional code of the two-dimensional code image (step S3). Specifically, the two-dimensional code decoding unit 43 converts the two-dimensional code of the two-dimensional code image received from the two-dimensional code detection unit 421 into transmission data, which is data before being converted into the two-dimensional code, and converts the transmission data into transmission data. is output to the output data restoration unit 44 .

Next, the server 4 separates the data obtained by decryption into output data identification information (header and footer) and output data (divided output data) (step S4). Specifically, the output data restoration unit 44 separates the transmission data received from the two-dimensional code detection unit 421 into a header and a footer, which are output data identification information, and divided output data. The output data identification information is information including information for identifying the output data such as the number of divisions and the data name of the output data (for example, file name). Here, the output data identification information is the header and footer, but the method of adding the output data identification information to the divided output data is not limited to this example. The right side of FIG. 7 shows an example in which the transmission data exemplified in FIG. ing. Since the number of divisions is 1 in this example, the output data after division is equal to the output data.

Next, the server 4 restores the output data before division based on the data name and division number (step S5). Specifically, if the number of divisions included in the output data identification information is 1, the output data restoration unit 44 uses the divided output data separated in step S4 as the output data. If the number of divisions included in the output data identification information is two or more, the output data restoration unit 44 generates output data by combining divided output data having the same data name included in the output data identification information. At this time, if the output data identification information includes a division number, the output data restoration unit 44 combines the divided output data in the order of the division number. The output data restoration unit 44 may combine the divided output data based on the information indicating the time as described above.

Next, the server 4 saves the output data (step S6). Specifically, the output data restoring unit 44 stores the output data restored in step S5 in the restored data saving unit 45 . The server 4 can restore the output data stored in the memory 15 of the control device 11 of the machine 1 by performing the processing shown in FIG. Further, the supplementary information is read from the captured image storage unit 41 by a control unit (not shown) that controls the server 4, and is stored in the restored data storage unit 45 in association with the restored data. As a result, the response computer 5 can read out the supplementary information and the corresponding output data from the restored data storage unit 45 and remotely diagnose and maintain the machine 1 using the read information.

Next, the hardware configuration of the control device 11 in the machine 1 of this embodiment will be described. The control device 11 of this embodiment is realized by, for example, a computer system. That is, the computer system functions as the control device 11 by executing a program, which is a computer program in which processing in the control device 11 is described, on the computer system. FIG. 8 is a diagram showing a configuration example of a computer system that implements the control device 11 of this embodiment. As shown in FIG. 8, this computer system comprises a processor 101, a memory 102, a display 103, an input section 104 and a communication section 105, which are connected via, for example, a system bus.

In FIG. 8, the processor 101 is, for example, a CPU (Central Processing Unit), MPU (Micro Processor Unit), etc., and executes a program describing the processing in the control device 11 of the present embodiment. A part of the processor 101 may be implemented by a processing circuit that is dedicated hardware such as an FPGA (Field-Programmable Gate Array). The memory 102 includes various memories such as RAM (Random Access Memory) and ROM (Read Only Memory) and storage devices such as hard disks, and stores programs to be executed by the processor 101, necessary data obtained in the process of processing, etc. to remember. The memory 102 is also used as a temporary storage area for programs.

The input unit 104 is composed of, for example, a keyboard, mouse, etc., and is used by the user of the computer system to input various information. The display 103 is composed of a display, LCD (liquid crystal display panel), etc., and displays various screens to the user of the computer system. Note that the input unit 104 and the display device 103 may be integrated and realized by a touch panel. A communication unit 105 is a receiver and a transmitter that perform communication processing. Note that FIG. 8 is an example, and the configuration of the computer system is not limited to the example in FIG.

Here, an example of the operation of the computer system until the program of the present embodiment becomes executable will be described. A computer program is installed in the memory 102 from a recording medium, for example, in the computer system having the configuration described above. Then, when the program is executed, the program read from the memory 102 is stored in the main storage area of the memory 102 . In this state, processor 101 executes processing as control device 11 of the present embodiment according to the program stored in memory 102 .

In the above description, a program describing processing in the control device 11 is provided as a recording medium. However, the recording medium is not limited to this. A program provided via a transmission medium such as the Internet via the communication unit 105 may be used.

The diagnostic program of the present embodiment, for example, divides the output data used for diagnosis in the control device 11 to generate a plurality of divided data, and each of the plurality of divided data is the identification information of the output data. It generates transmission data to which data identification information and division information indicating the order of division data is added, converts the transmission data into a two-dimensional code, and executes a process of displaying the two-dimensional code. Further, the diagnostic program of the present embodiment, for example, receives image data, which is data of an image in which the two-dimensional code displayed on the server 4 is imaged, from the portable information terminal that captured the image, , extracts the two-dimensional code, decodes the extracted two-dimensional code, and uses the data identification information and division information included in the decoded information obtained by decoding to execute the process of restoring the output data from multiple pieces of decoded information. Let

The two-dimensional code generation unit 13 and the transmission data conversion unit 14 shown in FIG. 1 are realized by executing the computer program stored in the memory 102 shown in FIG. 8 by the processor 101 shown in FIG. The memory 102 shown in FIG. 8 is also used to realize the two-dimensional code generator 13 and the transmission data converter 14 shown in FIG. Screen display unit 12 shown in FIG. 1 is implemented by display device 103 and processor 101 shown in FIG. Memory 15 shown in FIG. 1 is part of memory 102 shown in FIG.

The mobile information terminal 3 is realized by adding a camera 31 as a photographing device to the computer system with the configuration shown in FIG. 8, for example. The server 4 and the response computer 5 are also realized by the computer system having the configuration shown in FIG. 8, for example. The image analysis unit 42, the two-dimensional code decoding unit 43, and the output data restoration unit 44 shown in FIG. 1 are implemented by executing computer programs stored in the memory 102 shown in FIG. It is realized by The memory 102 shown in FIG. 8 is also used to implement the image analysis unit 42, the two-dimensional code decoding unit 43, and the output data restoration unit 44 shown in FIG. The captured image storage unit 41 and the restored data storage unit 45 shown in FIG. 1 are part of the memory 102 shown in FIG. Moreover, the server 4 and the correspondence computer 5 may each be realized by a plurality of computer systems. For example, the server 4 and the correspondence computer 5 may each be realized by a cloud computer system.

As described above, in this embodiment, the machine 1 displays the output data inside the machine 1 in one or more two-dimensional codes, and the area containing the two-dimensional code of the machine 1 is displayed by the portable information terminal 3. A photograph is taken and the photographed data is transmitted to the server 4, and the server 4 restores the output data from the photographed data. As a result, the output data of the machine 1 can be easily retrieved even when the machine 1 is not provided with an attachment port for an external storage medium and the network connection of the machine 1 is restricted. As a result, remote diagnosis and remote maintenance of the machine 1 can be realized while preventing information leakage. Also, when the amount of information in the output data is large, the machine 1 divides the output data, generates a two-dimensional code for each divided output data, and the server 4 restores the output data from the two-dimensional code. The amount of diagnostic information that can be presented can be increased.

Embodiment 2.
Next, the diagnostic system 6 of Embodiment 2 will be described. The configuration of the diagnostic system 6 of the present embodiment and the configuration of each device constituting the diagnostic system 6 are the same as those of the first embodiment. Hereinafter, the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.

FIG. 9 is a diagram showing an example of the device data output screen of this embodiment. In the device data output screen shown in FIG. 9, a screen for selecting output data is displayed in the same manner as the device data output screen shown in FIG. there is "LOGDATA.DAT" stores the log of the machine 1, and "LOGDATA.DAT" has a larger amount of information than "SYSTEM.DAT" exemplified in the explanation of the operation in the first embodiment.

If the amount of information in the output data is large, that is, if the data size is large, the size of the two-dimensional code converted from the data will also be large. Since the size of the two-dimensional code that can be displayed by the two-dimensional code display unit 122 is limited by the screen resolution and displayable area, there are cases where the output data cannot be represented by one two-dimensional code. be. For this reason, although division may be performed as described in Embodiment 1, compression may be performed to further reduce the data size. Moreover, from the viewpoint of information leakage prevention, the output data may be subjected to at least one of compression processing and encryption. In this embodiment, an example will be described in which at least one of compression processing and encryption is applied to output data as conversion processing in the transmission data conversion unit 14 .

FIG. 10 is a diagram showing an example of data generated by the transmission data conversion unit 14 and the two-dimensional code generation unit 13 of the control device 11 of this embodiment when compression processing is applied to the output data. FIG. 10 shows an example in which "LOGDATA.DAT" is selected on the device data output screen as shown in FIG. The transmission data conversion unit 14 reads the electronic file "LOGDATA.DAT" from the memory 15 as output data, and compresses the read output data.

The transmission data conversion unit 14 divides the compressed output data, which is the compressed output data, in the same manner as in the first embodiment, and outputs the divided data (divided output data) to the two-dimensional code generation unit 13 . The divided output data shown in FIG. 10 is converted output data that has undergone compression processing, which is an example of conversion processing, in the transmission data conversion unit 14 . The transmission data conversion unit 14 generates transmission data by adding a header and a footer to each divided output data, as in the first embodiment. In the example shown in FIG. 10, the header has "ZIP", which is information indicating the processing performed in the transmission data conversion unit 14, added after the data name. In the example shown in FIG. 10, since the number of divisions is 3, transmission data #1 to transmission data #3 are generated as transmission data corresponding to "LOGDATA.DAT".

The two-dimensional code generation unit 13 converts each of the transmission data #1 to transmission data #3 into two-dimensional codes (divided two-dimensional codes #1 to #3). FIG. 10 shows a state in which each two-dimensional code is displayed as an image. When the dimensional code display unit 122 displays the two-dimensional code as an image, the two-dimensional code illustrated in FIG. 10 is displayed.

11 and 12 are diagrams showing an example of a two-dimensional code output screen according to the present embodiment. In the examples shown in FIGS. 11 and 12, split two-dimensional codes #1 and #2 are displayed on the same screen page, which is one screen, and split two-dimensional code #3 is displayed on another screen page. . 11 and 12 show an example in which two two-dimensional codes are displayed on one screen page, but the number of two-dimensional codes displayed on one screen page is not limited to two. Anything above that is fine. The screen page to be displayed is switched, for example, by pressing "page switching" at the bottom of the two-dimensional code output screen.

The displayed two-dimensional code is photographed by the mobile information terminal 3 in the same manner as in the first embodiment, and the mobile information terminal 3 transmits photographed data representing the photographed image to the server 4 . As in the first embodiment, supplementary information may be transmitted to the server 4 together with the photographed data.

FIG. 13 is a flow chart showing an example of the operation of the server 4 of this embodiment. Steps S1 to S4 are the same as in the first embodiment. When two two-dimensional codes are included in one photographed image as shown in FIG. 11, the two-dimensional code detection unit 421 cuts out the two two-dimensional codes and sequentially applies them to the two-dimensional code decoding unit 43. Output to

After step S4, in step S5a, the output data restoration unit 44 combines according to the data name and the number of divisions, inversely transforms (decompresses) according to the transformation method, and restores the output data. Specifically, as in the first embodiment, the output data restoration unit 44 combines divided output data having the same data name, and converts the combined data inversely of the conversion performed by the control device 11. to restore the output data. For example, as described above, when compression processing has been performed, decompression processing is performed as inverse conversion. When encryption is performed in the control device 11, the ciphertext is converted into plaintext by performing decryption as inverse conversion. Step S6 after step S5a is the same as in the first embodiment. Further, when both encryption and compression are performed in the control device 11, inverse conversion of both is performed. Operations of the present embodiment other than those described above are the same as those of the first embodiment.

As described above, in this embodiment, output data is subjected to at least one of compression and encryption, and is displayed in one or more two-dimensional codes as in the first embodiment. The mobile information terminal 3 takes an image of the area containing the two-dimensional code, transmits the imaged data to the server 4, and the server 4 restores the output data from the imaged data. As a result, the same effects as in the first embodiment can be obtained, and effects such as increasing the data size that can be represented by one two-dimensional code by compression and preventing information leakage can be obtained. In addition, by displaying a plurality of two-dimensional codes on one screen page, it is possible to increase the data size of output data that can be transmitted with one image data.

Embodiment 3.
FIG. 14 is a diagram illustrating a configuration example of a diagnostic system according to a third embodiment; As shown in FIG. 14, the diagnostic system 6a of this embodiment is the same as that of the first embodiment except that the machine 1 is replaced with a machine 1a. The machine 1a is the same as the machine 1 of Embodiment 1 except that the controller 11 is replaced with a controller 11a. The control device 11a is the same as the control device 11 of Embodiment 1, except that the transmission data conversion section 14 is replaced with a transmission data conversion section 14a. Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted. Hereinafter, the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.

As shown in FIG. 14, the transmission data conversion unit 14a includes a division size adjustment unit 141. The division size adjustment unit 141 determines the data size of the division data corresponding to each of the plurality of two-dimensional codes to be displayed simultaneously, based on the size of the area in which the two-dimensional code can be displayed and the data size of the output data. Specifically, the division size adjustment unit 141 adjusts the size of the two-dimensional code to be displayed on one screen and the number of two-dimensional codes to be displayed on one screen according to the size of the area in which the two-dimensional code can be displayed. In a two-dimensional code, the amount of information that can be expressed in the two-dimensional code, that is, the amount of information that can be converted into the two-dimensional code increases according to the number of cells used in the two-dimensional code. For this reason, for example, if the size of each cell of the two-dimensional code is determined in advance by how many pixels, the data size that can be converted into the two-dimensional code can be associated with the size of the two-dimensional code.

FIG. 15 is a diagram showing an example of the size of the two-dimensional code output screen displayed by the control device 11a of the present embodiment. In the example shown in FIG. 15, a two-dimensional code can be displayed in the area 201, and the resolution of the display 103 that implements the machine 1a is 380 points in the vertical direction and 380 points in the horizontal direction. 640pt.

16 and 17 are diagrams showing examples of two-dimensional codes displayed by the control device 11 of Embodiment 1. FIG. In the example shown in FIGS. 16 and 17, a two-dimensional code corresponding to output data with a division number of 2 is generated. In the first embodiment that does not include the division size adjusting unit 141, for example, the output data is divided for each division size corresponding to the size of the two-dimensional code that can be displayed after securing a certain margin in the top, bottom, left, and right within the area 201. be done. Further, in the first embodiment, when the data size of the output data is not divisible by the division size, the final divided output data is less than the division size. For this reason, for example, as shown in FIGS. 16 and 17, a two-dimensional code of 356pt×356pt is displayed on the first screen page, and 180pt×180pt is displayed on the second screen page. In this example, two two-dimensional codes will be displayed over two screen pages.

FIG. 18 is a diagram showing an example of a two-dimensional code displayed by the control device 11a of this embodiment. The example shown in FIG. 18 shows an example in which output data having the same size as the output data shown in FIGS. 16 and 17 is divided as two two-dimensional codes. Therefore, in the example shown in FIG. 18, two two-dimensional codes can be displayed on one screen page, and the portable information terminal 3 can photograph two two-dimensional codes at once. As described above, in the present embodiment, the size of the two-dimensional code is determined by the division size adjusting unit 141 so that the number of screen pages on which the two-dimensional code is displayed is reduced, and the two-dimensional code is divided according to the determined two-dimensional code. size is determined.

The transmission data conversion unit 14a determines the division size based on the data size of the output data read from the memory 15 so as to reduce the number of screen pages on which the two-dimensional code is displayed. The output data is divided in the same manner as in 1, and transmission data is generated by adding a header and a footer to the divided output data. Operations of the present embodiment other than those described above are the same as those of the first embodiment. Further, the hardware configuration of the control device 11a of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.

Note that although an example in which the division size adjustment unit 141 is added to the transmission data conversion unit 14 of the first embodiment has been described here, similarly, the transmission data conversion unit 14 of the second embodiment may be provided. That is, the transmission data conversion unit 14 performs at least one of compression and encryption on the output data, and divides the data so that the number of screen pages on which the two-dimensional code is displayed is reduced based on the data size of the processed data. A size may be determined.

As described above, in this embodiment, the division size is determined so that the number of screen pages on which the two-dimensional code is displayed is reduced. As a result, the same effect as in the first embodiment can be obtained, and the number of screen pages on which the two-dimensional code is displayed can be reduced, and the number of times the mobile information terminal 3 takes pictures can be reduced.

Embodiment 4.
FIG. 19 is a diagram illustrating a configuration example of a diagnostic system according to a fourth embodiment; As shown in FIG. 19, the diagnostic system 6b of this embodiment is the same as that of the first embodiment except that the machine 1b is replaced with the machine 1b. The machine 1b is the same as the machine 1 of Embodiment 1 except that the controller 11 is replaced with a controller 11b. The control device 11b is the same as the screen display section 12 of the first embodiment except that the screen display section 12a is replaced with the screen display section 12a. The screen display section 12a is the same as the screen display section 12 of the first embodiment except that the device data output section 121 is replaced with a device data output section 121a. The device data output section 121a is the same as the device data output section 121 of the first embodiment except that the two-dimensional code display section 122 is replaced with a two-dimensional code display section 122a. Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted. Hereinafter, the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.

In the present embodiment, the two-dimensional code display section 122a includes the automatic page switching section 123. The automatic page switching unit 123 automatically switches the screen page on which the two-dimensional code is displayed.

FIG. 20 is a diagram showing an example of screen page display switching and its time chart by the automatic page switching unit 123 of the present embodiment. As shown in FIG. 20, when the automatic page switching unit 123 displays a two-dimensional code corresponding to one piece of output data over a plurality of screen pages, for example, the "automatic switching" at the bottom of the two-dimensional code display screen is set to When pressed, the screen page is automatically switched. As shown in FIG. 20, the automatic page switching unit 123 sequentially displays, for example, screen pages from page #1 to the final page at switching intervals that are constant times. Further, a repeated display may be performed in which screen pages from page #1 to the final page are repeatedly displayed. When repetitive display is performed, after page #1 to the final page are displayed, after a predetermined repetitive display pause interval, display from page #1 to the final page is repeated again. Repeat until instructed to stop or a specified number of times. The repeat display pause interval may be user configurable. The specified number of times may be predetermined or may be set by the user.

In the present embodiment, the mobile information terminal 3 is configured to capture moving images or still images so that all screen pages from page #1 to the final page displayed by automatic switching as described above are captured. A two-dimensional code display screen is photographed by continuous shooting. Shooting data indicating data shot by continuous shooting of moving images or still images includes a plurality of shot images corresponding to different times. Portable information terminal 3 transmits the photographed data to server 4 in the same manner as in the first embodiment.

FIG. 21 is a diagram showing an example of a method for extracting a two-dimensional code image when photographed as a moving image according to the present embodiment. The image analysis unit 42 of the server 4 reads the photographed data, which is moving image data, from the photographed image storage unit 41, and cuts out images (image snapshots) for all image pages at image cutout intervals determined from the moving image data. The image clipping interval is determined, for example, as switching interval/N (N is a natural number). Note that when N is 1, the image may not be correctly extracted if the timing for extracting an image from the moving image data coincides with the page switching timing of the two-dimensional code display screen, so N is preferably 2 or more. However, the present invention is not limited to this, and it is sufficient if the image clipping interval < (switching interval - time required for updating the image). The time required to update the image is the time required for updating the image when switching the image to be displayed in the control device 11 .

The two-dimensional code detection unit 421 of the image analysis unit 42 cuts out a two-dimensional code image from each cut-out image in the same manner as in the first embodiment, and sequentially outputs the cut-out two-dimensional code images to the two-dimensional code decoding unit 43. .

Note that the two-dimensional code detection unit 421 compares the two-dimensional codes of the cut out images, and if it determines that the images of the same two-dimensional code are continuous, it detects one image from the same two-dimensional code image. One of them may be selected and output to the two-dimensional code decoding unit 43 . Further, when screen pages are displayed in the screen page display areas 202 to 204 of the two-dimensional code output screen in the same manner as in the examples shown in FIGS. Duplicates may be determined based on 202-204. For example, the image analysis unit 42 detects the screen page display areas 202 to 204 from each clipped image, and detects the numbers indicating the screen pages in the screen page display areas 202 to 204 by image recognition processing. If images with the same number are continuous, select one of the continuous images, cut out the two-dimensional code image from the unselected image, and cut out the two-dimensional code image from the unselected image. may not be cut out. Alternatively, when the output data restoration unit 44 at the subsequent stage obtains a plurality of pieces of transmission data in which the page number, which is the division number included in the output identification information in the decoded transmission data, overlaps, the transmission data is selected from a plurality of The output data may be restored using one transmission data.

FIG. 22 is a diagram showing an example of a method for extracting a two-dimensional code image when still images are shot continuously according to the present embodiment. The image analysis unit 42 of the server 4 reads the photographed data obtained by continuous shooting from the photographed image storage unit 41, and cuts out each still image from the photographed data. In the case of continuous shooting, if the number of still images shot by continuous shooting per second is M (M is a natural number), then the continuous shooting interval, which is the cycle of continuous shooting, is 1/M seconds. is. If the switching interval is too long compared to the continuous shooting interval, the same screen page will be shot many times. Therefore, by setting the switching interval to be short, such as less than one second, it is possible to shorten the shooting time required to shoot a full-screen page and suppress the data size of the shooting data. For example, the cycle of continuous shooting can be set to a natural number fraction of the switching interval. When continuous shooting is performed, each of a plurality of still images is generated as an electronic file, so the shooting data transmitted from the portable information terminal 3 is data containing a plurality of image data.

The two-dimensional code detection unit 421 of the image analysis unit 42 cuts out a two-dimensional code image from a plurality of images indicated by a plurality of image data included in the photographed data in the same manner as in the first embodiment, and sequentially extracts the cut-out two-dimensional code image. Output to the two-dimensional code decoding unit 43 . As in the case of moving image data, the two-dimensional code detection unit 421 compares the two-dimensional code of each clipped image. One may be selected from the two-dimensional code images and output to the two-dimensional code decoding section 43 . In addition, as in the case of moving image data, overlap may be determined based on the screen page display areas 202 to 204 and an image may be selected. The page number, which is a number, may be used to restore the output data using one transmission data selected from a plurality of transmission data.

As described above, in the present embodiment, the two-dimensional code screen on which the control device 11b displays the two-dimensional code is displayed within a certain period of time when the two-dimensional code corresponding to one piece of output data is displayed over a plurality of screen pages. Screen pages are automatically switched at certain switching intervals. In addition, the photographed data photographed by the portable information terminal 3 is data of a moving image photographed so as to include a plurality of screen pages, or a plurality of still images photographed by continuous photographing at a cycle equal to a natural number of the switching interval. data. When the photographed data is moving image data, the server 4 extracts images corresponding to a plurality of screen pages from the photographed data using the switching interval, and extracts a two-dimensional code from the extracted images. Further, when the photographed data is data representing a plurality of still images photographed by continuous shooting, the server 4 extracts images corresponding to a plurality of screen pages from the photographed data using the continuous photographing interval, and extracts the extracted images. Extract the two-dimensional code from

The operations of this embodiment other than those described above are the same as those of the first embodiment. Further, the hardware configuration of the control device 11b of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.

Although an example in which the automatic page switching unit 123 is added to the two-dimensional code display unit 122 of the first embodiment has been described here, the two-dimensional code display unit 122 of the second or third embodiment automatically The page switching unit 123 may be provided, and the server 4 may perform the operation of this embodiment.

As described above, in the present embodiment, the automatic page switching unit 123 automatically switches screen pages. This eliminates the need for the user to manually switch between screen pages, and the user only needs to use the portable information terminal 3 to shoot moving images or continuous shots. In addition, it is possible to efficiently acquire photographed data.

Embodiment 5.
Next, the diagnostic system 6 of Embodiment 5 will be described. The configuration of the diagnostic system 6 of the present embodiment and the configuration of each device constituting the diagnostic system 6 are the same as those of the first embodiment. Hereinafter, the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted. In this embodiment, an example of converting a plurality of pieces of output data into a two-dimensional code will be described.

FIG. 23 is a diagram showing an example of the device data output screen of this embodiment. As with the device data output screen shown in FIG. 2, the device data output screen shown in FIG. 23 displays a screen for selecting output data. DAT" and "PARAMET.DAT" are selected.

FIG. 24 is a diagram showing an example of data generated by the transmission data conversion unit 14 and the two-dimensional code generation unit 13 of the control device 11 of this embodiment. In the example shown in FIG. 24, the user selects "TOOLDATA.DAT", "OFFSET.DAT", and "PARAMET.DAT" as output data as shown in FIG.

As shown in FIG. 24, for example, when "TOOLDATA.DAT", "OFFSET.DAT", and "PARAMET.DAT" are selected as output data, the transmission data conversion unit 14 divides each output data, The transmission data A to C are generated by adding the output data identification information including the data name of the output data to the divided output data. As described in the first embodiment, the number of divisions may be one. When the data size of the output data is large, the output data is divided. In the example shown in FIG. 24, the number of divisions of "TOOLDATA.DAT" is two, the number of divisions of "OFFSET.DAT" is one, and the number of divisions of "PARAMET.DAT" is two. Therefore, there are two transmission data A corresponding to the output data A "TOOLDATA.DAT", and one transmission data B corresponding to the output data B "OFFSET.DAT", and the output data C There are two pieces of transmission data C corresponding to "PARAMET.DAT".

Further, as described in the second embodiment, the output data may be subjected to conversion processing, which is at least one of compression and encryption. In the example shown in FIG. 24, ZIP compression is applied to the output data. It is In the example shown in FIG. 24, as in the second embodiment, the data name of the output data, the number of divisions, the division number, and information indicating the conversion process are added as a header. Note that FIG. 24 is an example, and the conversion processing to be applied to the output data, the number of divisions, and the like are not limited to the example shown in FIG. Also, the output data may not be subjected to conversion processing.

The two-dimensional code generation unit 13 receives each transmission data generated by the transmission data conversion unit 14 and generates a corresponding two-dimensional code. In the example shown in FIG. 24, two two-dimensional codes A corresponding to output data A, one two-dimensional code B corresponding to output data B, and two two-dimensional codes C corresponding to output data C are generated. be.

For example, two two-dimensional codes A are displayed on one screen page, two-dimensional code B is displayed on another one-screen page, and two two-dimensional codes C are displayed on another one-screen page. The information terminal 3 photographs each screen page. As a result, the mobile information terminal 3 acquires three shot data corresponding to each screen page, and transmits the three shot data to the server 4 .

FIG. 25 is a flow chart showing an example of the operation of the server 4 of this embodiment. Steps S1 to S4 and S6 shown in FIG. 25 are the same as in the first embodiment. In step S5b, the output data restoration unit 44 restores the output data in the same manner as in the first embodiment. based on the order in which they were divided. As a result, output data A to C shown in FIG. 25 can be restored from photographed data obtained by photographing two-dimensional codes A to C shown in FIG. In the example shown in FIG. 24, since the data is compressed by ZIP as described in the second embodiment, the output data restoration unit 44 decompresses the combined output data.

The operations of the present embodiment other than those described above are the same as those of the first or second embodiment. Further, the hardware configuration of the control device 11b of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment.

Here, the diagnostic system 6 of Embodiment 1 or Embodiment 2 has been described as an example, but in the diagnostic system 6a of Embodiment 3 and the diagnostic system 6b of Embodiment 4, a plurality of output data are If selected, similar processing can be performed.

Also, in the example shown in FIGS. 24 and 25, all of the output data A to C are compressed, but conversion processing to be performed for each output data may be determined. For example, output data A and C may be compressed, and output data B may not be converted. The content of the conversion process may be determined for each output data, that is, for each type of output data, or may be determined according to the data size of the output data.

As described above, even when multiple types of output data are selected, remote diagnosis and remote maintenance of the machine 1 can be realized without using an external storage medium and the network connection function of the machine 1. Also, when the amount of information in the output data is large, the machine 1 divides the output data, generates a two-dimensional code for each divided output data, and the server 4 restores the output data from the two-dimensional code. The amount of diagnostic information that can be presented can be increased.

Embodiment 6.
FIG. 26 is a diagram illustrating a configuration example of a diagnostic system according to a sixth embodiment; A diagnostic system 6c of the present embodiment includes a machine 1c, a Web server 7 that is an example of the server 4 described in the first embodiment, and a response computer 5. FIG. Note that the portable information terminal 3a may be included in the diagnostic system 6c. The web server 7 has the function of the server 4 described in the first embodiment. Components having functions similar to those of the first embodiment are denoted by the same reference numerals as those of the first embodiment, and overlapping descriptions are omitted. Hereinafter, the points different from the first embodiment will be mainly described, and descriptions overlapping with the first embodiment will be omitted.

The machine 1c is the same as the control device 11 of Embodiment 1 except that it has a control device 11c instead of the control device 11. The control device 11c is the same as the control device 11 of Embodiment 1 except that a self-diagnostic unit 18 is added. The self-diagnostic unit 18 performs self-diagnosis of the health condition of the machine 1c using the information indicating the state of the machine 1c stored in the memory 15, the machine signal of the machine peripheral device 2, and the like, and displays the self-diagnosis result. It generates diagnostic data and outputs the self-diagnostic data to the transmission data converter 14 . The transmission data converter 14 uses the self-diagnostic data as the output data of the first embodiment to generate transmission data in the same manner as in the first embodiment. The operations of the two-dimensional code generation unit 13 and the screen display unit 12 are the same as those of the first embodiment.

In the present embodiment, an example will be described in which a diagnostic service for responding to inquiries, diagnostic requests, etc. regarding the machine 1c is provided on the Web. For example, the web server 7 has a function of providing information provided as a web page (not shown) to terminals such as the portable information terminal 3a in response to access requests from the terminals. A user who makes an inquiry about the machine 1c or requests a diagnosis operates the mobile information terminal 3a to display information on the Web page on the mobile information terminal 3a.

The portable information terminal 3a is the same as the portable information terminal 3 of Embodiment 1, except that an authentication unit 34 is added. The authentication unit 34 performs user authentication processing for using the diagnostic service. For example, the authentication unit 34 transmits a pre-registered user ID (IDentifier: identification information) and password to the Web server 7 in order to use the diagnostic service. The user ID and password may be input to the mobile information terminal 3a by the user, or may be stored in the mobile information terminal 3a. Note that the authentication method is not limited to this example.

The user uses the portable information terminal 3a to take a photographed image including the two-dimensional code and acquire photographed data, as in the first embodiment. After being authenticated, the user uses the portable information terminal 3a to post post data including photographed data to a user post page, which is a post page dedicated to the user. That is, the mobile information terminal 3a transmits the post data to the web server 7 based on the input from the user. A posting page may be provided for each thread.

The web server 7 includes an authentication unit 71, a user posted data management unit 72, a posted data storage unit 73, an image recognition unit 74, a learning data storage unit 75, a data storage unit 76, a message notification unit 77, an image analysis unit 42, two A dimension code decoder 43 and an output data restorer 44 are provided. The image analysis unit 42, the two-dimensional code decoding unit 43 and the output data restoration unit 44 are the same as the image analysis unit 42, the two-dimensional code decoding unit 43 and the output data restoration unit 44 of the server 4 of the first embodiment.

Authentication unit 71 performs authentication processing with portable information terminal 3a, and upon receiving posted data transmitted from successfully authenticated portable information terminal 3a, authenticates the posted data together with corresponding user identification information to user posted data management unit. 72. User posted data management portion 72 stores the posted data in posted data storage portion 73 . In addition, upon receiving the posted data, user posted data management portion 72 notifies message notification portion 77 that the posted data has been posted. The posted data stored in posted data storage portion 73 is managed for each user. Further, when a posting page is provided for each thread, the posted data stored in posted data storage portion 73 may be managed for each thread.

The two-dimensional code detection unit 421 of the image analysis unit 42 reads the posted data for each item stored in the posted data storage unit 73, extracts the two-dimensional code image from the photographed data included in the posted data, and extracts the extracted two-dimensional code image. The dimension code image is output to the two-dimensional code decoding section 43 . The two-dimensional code detection unit 421 may extract the two-dimensional code image from the photographed data by the same method as in the first embodiment, but the image recognition result obtained by the image recognition unit 74 shown in FIG. A two-dimensional code image may be extracted. In this case, the two-dimensional code detection unit 421 outputs the photographed data to the image recognition unit 74, and the image recognition unit 74 uses the feature amount teaching data stored in the learning data storage unit 75 to convert the photographed data into Each characteristic part is specified from the photographed image shown, the two-dimensional code in the photographed image is recognized using the specified result, and the recognition result is notified to the two-dimensional code detection unit 421 .

The image recognition unit 74 recognizes a characteristic portion, which is a predetermined characteristic portion, by pattern recognition or the like. The characteristic parts are, for example, a common frame that is the outer frame of the two-dimensional code display screen, a display frame that is an area in which the two-dimensional code can be displayed, square-shaped parts provided at three corners of the two-dimensional code, and the screen. The part where the page is displayed, etc. Pattern recognition may be performed by machine learning. That is, the image recognition unit 74 recognizes the position of the two-dimensional code in the image represented by the photographed data by machine learning based on the feature amount of the image representing the two-dimensional code, and sends the recognition result to the two-dimensional code detection unit 421. may be output.

FIG. 27 is a diagram showing an example of a characteristic portion of the two-dimensional code display screen of this embodiment. In FIG. 27, the characteristic portions are a characteristic portion F1 which is a common frame of the two-dimensional code output screen, a characteristic portion F2 which is a display frame capable of displaying the two-dimensional code, and three corners of the two-dimensional code. A characteristic portion F3, which is a square-shaped portion where the screen page is displayed, and a characteristic portion F4, which is a portion where the screen page is displayed, are exemplified. Information indicating the arrangement of the characteristic portions F1 to F4 and the characteristic amounts of the characteristic portions F1 to F4 of the two-dimensional code as illustrated in FIG. put. The feature amount may be of any type, and may include, for example, line shape, line length, line inclination, color, etc., or may be the image itself. The image recognition unit 74 uses the feature amount teaching data stored in the learning data storage unit 75 to identify each characteristic portion from the photographed image indicated by the photographed data, thereby recognizing the position of the two-dimensional code in the photographed image. Detection accuracy can be improved.

Note that the image recognition by the image recognition unit 74 may be performed by machine learning such as supervised learning. A neural network, a support vector machine, or the like can be used as a supervised learning algorithm, but is not limited to these. For example, the image recognition unit 74 includes a learned model generation unit, an inference unit, and a preprocessing unit. do. Also, an image that is not a two-dimensional code is prepared, and the feature amount is calculated from the image. The trained model generation unit uses the calculated feature amount as input data, sets the input data and information indicating whether or not it is a two-dimensional code image as the corresponding correct data as a learning data set, and creates a learning data set. are used to generate a learned model, and the learned model is stored in the learning data storage unit 75 . At the time of inference, that is, when extracting a two-dimensional code image, the preprocessing unit cuts out a part of the photographed image represented by the photographed data, extracts the feature amount from the cut out image, and the inference unit By inputting the feature amount into the learned model stored in the learning data storage unit 75, it is inferred whether or not the input image is the image of the two-dimensional code. By sequentially changing the region of the image cut out from the photographed image and performing these processes, the inference unit can obtain a cut out image that is inferred to be the image of the two-dimensional code. Note that even if the image recognition unit 74 does not include a trained model generation unit, a learning device that generates a trained model is separately provided, and the trained model generated by the learning device is stored in the learning data storage unit 75. good.

Return to the description of FIG. The two-dimensional code decoding unit 43 and the output data restoring unit 44 perform the same processing as in the first embodiment. The output data restoring unit 44 stores the restored output data in the restored data saving unit 45 in the data storage unit 76 on a case-by-case basis. Information other than the photographed data in the posted data is read from the posted data storage unit 73 by a control unit (not shown) that controls the web server 7, and stored in the data storage unit 76 in association with the restored data. be.

When the message notification unit 77 is notified of the posting, it notifies the response computer 5 of the posting. Further, the message notification unit 77 transmits a later-described reply to the posting from the reception computer 5 to the portable information terminal 3a. In addition, the message notification unit 77 may notify the operator of the posting by transmitting the message to a terminal (not shown) of the operator.

The response computer 5 includes a diagnostic information storage unit 51 , an AI (Artificial Intelligence) bot 52 and an answer transmission unit 53 . The response computer 5 of Embodiments 1 to 5 may be the same as the response computer 5 of the present embodiment, or may have a different configuration from the response computer 5 of the present embodiment.

The diagnostic information storage unit 51 stores device diagnostic information for diagnosing the machine 1c. The device diagnostic information may be stored in the diagnostic information storage unit 51 as, for example, a device diagnostic DB (DataBase). The device diagnosis information includes, for example, an analysis flowchart for obtaining a primary diagnosis result according to the content of the output data, an analysis flowchart for performing a secondary diagnosis based on the primary diagnosis result, and a coping method based on the primary diagnosis result (inspection points, inspection methods, direct inquiries, etc.). In addition, as a coping method, the device diagnostic information may include an image, a document, or the like for explaining inspection points, inspection methods, and the like.

When AI bot 52, which is an automatic conversation unit, is notified that a post has been made, it outputs information indicating a predetermined primary response to answer transmission unit 53, and restores the restored data in data storage unit 76 of Web server 7. Output data is acquired from the storage unit 45 on a case-by-case basis. AI bot 52 uses the obtained output data and the device diagnostic information stored in diagnostic information storage unit 51 to generate an answer to the post, and outputs the generated answer to answer transmission unit 53 . For example, the AI bot 52 performs a primary diagnosis using the acquired output data and the device diagnostic information stored in the diagnostic information storage unit 51, and generates a response including the primary diagnostic result and coping methods. When a response to the coping method is received via the mobile information terminal 3a and the Web server 7 by presenting the coping method to the user, the response and the device diagnostic information stored in the diagnostic information storage unit 51 are used to A secondary diagnosis is performed, and an answer including the secondary diagnosis result and coping method is generated. Note that the method of calculating the diagnosis result by the AI bot 52 is not limited to this.

It should be noted that the operator may respond to the post when the operator is present, and the AI bot 52 may respond when the operator is absent. In addition, regarding inquiries that cannot be handled by the AI bot 52, the operator may prepare a response using a paper manual or the like.

The response transmission unit 53 transmits the response received from the AI bot 52 to the web server 7. User posted data management section 72 of Web server 7 outputs the reply transmitted from reply transmission section 53 to message notification section 77 . The message notification unit 77 transmits the reply received from the user posted data management unit 72 to the mobile information terminal 3a.

FIG. 28 is a diagram showing an example of diagnosis in the diagnostic system 6c of this embodiment. As shown in FIG. 28, for example, a user contribution page screen 301 is displayed on the mobile information terminal 3a. A user of the machine 1c posts by operating the portable information terminal 3a. In the example shown in FIG. 28, the user inputs a message indicating that an alarm xx has occurred, and together with this message, the photographed data obtained by photographing the two-dimensional code corresponding to the self-diagnostic data of the machine 1c is the posted data. is transmitted from the mobile information terminal 3a to the Web server 7 as the data. A two-dimensional code corresponding to other output data may be generated together with the self-diagnostic data, and photographed data obtained by photographing the two-dimensional code may be transmitted as posted data.

Self-diagnosis data, which is output data, is restored by the image analysis unit 42, the two-dimensional code decoding unit 43, and the output data restoration unit 44 using the photographed data included in the posted data stored in the posted data storage unit 73. On the other hand, in the Web server 7, the message notification unit 77 notifies the AI bot 52 and the operator that the posted data has been posted, and the AI bot 52 or the operator makes a primary response. Note that the primary response of the AI bot 52 is transmitted to the mobile information terminal 3a via the web server 7 as described above. In the example shown in FIG. 28, the message "accepted" is displayed as the primary response.

The AI bot 52 performs a primary diagnosis using the self-diagnosis data and the device diagnosis DB, and transmits a coping method corresponding to the primary diagnosis result to the mobile information terminal 3a as a secondary response. The secondary response of the AI bot 52 is also transmitted to the mobile information terminal 3a via the web server 7. FIG. The primary diagnosis result of the AI bot 52 may be transmitted to the operator's terminal or the like, and the operator may transmit the secondary response from the terminal or the like to the mobile information terminal 3a. In the example shown in FIG. 28, a primary diagnosis result, a coping method, and an image corresponding to the coping method are displayed as secondary responses.

FIG. 28 is an example, and the specific response content is not limited to the example shown in FIG. Also, in FIG. 26, the response from the AI bot 52 is transmitted via the web server 7, but it may be transmitted from the reception computer 5 to the mobile information terminal 3a.

The operations of this embodiment other than those described above are the same as those of the first embodiment. Further, the hardware configuration of the control device 11c of the present embodiment is the same as the hardware configuration of the control device 11 of the first embodiment. The Web server 7 of this embodiment also has the same hardware configuration as the server 4 of the first embodiment.

Here, the difference from the first embodiment is explained based on the first embodiment, but the configuration and operation described in the present embodiment are added to the diagnostic systems of the second to fifth embodiments. may

As described above, in the present embodiment, the mobile information terminal 3a captures the two-dimensional code corresponding to the output data of the machine 1c, and uploads the captured data to the user contribution page managed by the web server 7. Post. Since the Web server 7 restores the output data from the photographed data, even if the computer 5 needs to acquire a plurality of types of information for diagnosis, the computer 5 can respond to the post. Corresponding output data can be easily verified. In addition, the response computer 5 reads out the output data of the machine 1c from the Web server 7 and performs diagnosis using the output data, so that the operator can remotely diagnose and maintain the machine 1c without going to the place where the machine 1c is installed. be able to.

The configurations shown in the above embodiments are only examples, and can be combined with other known techniques, or can be combined with other embodiments, without departing from the scope of the invention. It is also possible to omit or change part of the configuration.

1, 1a, 1b, 1c Machine, 2 Machine peripherals, 3, 3a Personal digital assistant, 4 Server, 5 Reception computer, 6, 6a, 6b, 6c Diagnostic system, 7 Web server, 11, 11a, 11b, 11c Control Device, 12, 12a screen display unit, 13 two-dimensional code generation unit, 14, 14a transmission data conversion unit, 15 memory, 16 drive unit, 17 mechanical signal processing unit, 18 self-diagnosis unit, 31 camera, 32 captured image memory, 33 network communication unit, 34, 71 authentication unit, 41 captured image storage unit, 42 image analysis unit, 43 two-dimensional code decoding unit, 44 output data restoration unit, 45 restored data storage unit, 51 diagnosis information storage unit, 52 AI bot , 53 answer transmission unit, 72 user posted data management unit, 73 posted data storage unit, 74 image recognition unit, 75 learning data storage unit, 76 data storage unit, 77 message notification unit, 121, 121a device data output unit, 122 , 122a two-dimensional code display unit, 123 automatic page switching unit, 141 division size adjustment unit, 421 two-dimensional code detection unit.

Claims

Controlling a machine and dividing output data used for at least one of diagnosis and maintenance of the machine to generate a plurality of divided data, each of the plurality of divided data having identification information of the output data. a control device that generates transmission data to which data identification information and division information indicating the order of the division data is added, converts the transmission data into a two-dimensional code, and displays the two-dimensional code;
Captured data, which is data of an image in which the displayed two-dimensional code is captured, is received from the information terminal that captured the image, the two-dimensional code is extracted from the captured data, and the extracted two-dimensional code is extracted. a server that decodes a code and restores the output data from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding;
A diagnostic system comprising:
The control device determines the data size of the divided data corresponding to each of the plurality of two-dimensional codes to be displayed simultaneously, based on the size of the area in which the two-dimensional code can be displayed and the data size of the output data. 2. The diagnostic system of claim 1, wherein:
When the two-dimensional code corresponding to one output data is displayed over a plurality of screen pages, the two-dimensional code screen on which the control device displays the two-dimensional code is displayed at switching intervals that are constant time. The page will automatically switch,
The photographed data is data of a moving image photographed so as to include the plurality of screen pages,
The server extracts images corresponding to the plurality of screen pages from the photographed data using the switching interval, extracts the two-dimensional code from the extracted images, and converts the extracted two-dimensional code to 3. The diagnosis according to claim 1, wherein the output data is restored from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding. system.
When the two-dimensional code screen on which the control device displays the two-dimensional code displays a plurality of two-dimensional codes corresponding to one output data over a plurality of screen pages, The screen page switches automatically,
The photographed data is data of a plurality of still images photographed by continuous shooting at a cycle equal to the natural number divided by the switching interval so as to include the plurality of screen pages,
The server extracts images corresponding to a plurality of screen pages from the plurality of still images using the period, extracts the two-dimensional code from the extracted images, and decodes the extracted two-dimensional code. 3. The diagnostic system according to claim 1, wherein said output data is restored from a plurality of pieces of said decoded information using said data identification information and said division information contained in decoded information obtained by decoding.
The server recognizes the position of the two-dimensional code in the image indicated by the photographed data by machine learning based on the feature amount of the image indicating the two-dimensional code, and uses the recognition result to determine the position of the two-dimensional code from the photographed data. , to extract the two-dimensional code.
A control device for controlling a machine,
A plurality of divided data are generated by dividing output data used for at least one of diagnosis and maintenance of the machine, and each of the plurality of divided data includes data identification information that is identification information of the output data and the a transmission data conversion unit that generates transmission data to which division information indicating the order of the division data is added;
a two-dimensional code generator that converts the transmission data into a two-dimensional code;
a two-dimensional code display unit that displays the two-dimensional code;
A control device comprising:
When the two-dimensional code corresponding to one output data is displayed over a plurality of screen pages, the two-dimensional code display unit automatically switches the screen page at each switching interval that is a constant time. 7. A control device according to claim 6.
photographing as a moving image by an information terminal so as to include the plurality of screen pages and transmitting the photographed data to a server;
The server extracts images corresponding to the plurality of screen pages from the photographed data using the switching interval, extracts the two-dimensional code from the extracted images, and decodes the extracted two-dimensional code. 8. The control device according to claim 7, wherein the output data is restored from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding.
Data of a plurality of still images captured by continuous shooting at a cycle equal to a natural number divided by the switching interval is transmitted to the server as captured data, so as to include the plurality of screen pages;
The server extracts images corresponding to a plurality of screen pages from the plurality of still images using the period, extracts the two-dimensional code from the extracted images, and decodes the extracted two-dimensional code. 8. The control device according to claim 7, wherein the output data is restored from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding.
A control device for controlling a machine divides output data used for at least one of diagnosis and maintenance of the machine to generate a plurality of divided data, each of the plurality of divided data includes an identification of the output data. generating transmission data to which data identification information as information and division information indicating the order of the division data are added, converting the transmission data into a two-dimensional code, displaying the two-dimensional code;
A server receives photographed data, which is data of an image in which the displayed two-dimensional code is photographed, from the information terminal that photographed the image, extracts the two-dimensional code from the photographed data, and extracts the extracted two-dimensional code. A diagnostic method comprising decoding the two-dimensional code, and reconstructing the output data from a plurality of pieces of the decoded information using the data identification information and the division information contained in the decoded information obtained by decoding.
The control device determines the data size of the divided data corresponding to each of the plurality of two-dimensional codes to be displayed simultaneously, based on the size of the area in which the two-dimensional code can be displayed and the data size of the output data. The diagnostic method according to claim 10, characterized in that:
When the two-dimensional code screen on which the control device displays the two-dimensional code displays a plurality of two-dimensional codes corresponding to one output data over a plurality of screen pages, The screen page switches automatically,
The photographed data is data of a moving image photographed so as to include the plurality of screen pages,
The server extracts images corresponding to the plurality of screen pages from the photographed data using the switching interval, extracts the two-dimensional code from the extracted images, and converts the extracted two-dimensional code to 12. The diagnosis according to claim 10, wherein the output data is restored from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding. Method.
When the two-dimensional code screen on which the control device displays the two-dimensional code displays a plurality of two-dimensional codes corresponding to one output data over a plurality of screen pages, The screen page switches automatically,
The photographed data is data of a plurality of still images photographed by continuous shooting at a cycle equal to the natural number divided by the switching interval so as to include the plurality of screen pages,
The server extracts images corresponding to a plurality of screen pages from the plurality of still images using the period, extracts the two-dimensional code from the extracted images, and decodes the extracted two-dimensional code. 12. The diagnostic method according to claim 10, wherein the output data is restored from a plurality of pieces of the decoded information using the data identification information and the division information included in the decoded information obtained by decoding.
The server recognizes the position of the two-dimensional code in the image indicated by the photographed data by machine learning based on the feature amount of the image indicating the two-dimensional code, and uses the recognition result to determine the position of the two-dimensional code from the photographed data. , extracting the two-dimensional code.
In the control device that controls the machine,
A plurality of divided data are generated by dividing output data used for at least one of diagnosis and maintenance of the machine, and each of the plurality of divided data includes data identification information that is identification information of the output data and the generating transmission data to which division information indicating the order of the division data is added, converting the transmission data into a two-dimensional code, and executing a process of displaying the two-dimensional code;
to the server,
Captured data, which is data of an image in which the displayed two-dimensional code is captured, is received from the information terminal that captured the image, the two-dimensional code is extracted from the captured data, and the extracted two-dimensional code is extracted. A diagnostic program that decodes a code and uses the data identification information and the division information included in the decoded information obtained by decoding to execute a process of restoring the output data from a plurality of the decoded information.