JP7167953B2 - Information processing device, information processing method and program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and a program.

Patent Document 1 discloses current sensors 31, 32, and 33 for detecting current values of first, second, and third servo motors 14, 18, and 21, and a current sensor 34 for detecting motor current values of a spindle motor 30. , a vibration sensor 35 for detecting the vibration of the nose of the spindle head 22, and a CCD camera 47 for photographing the machined surface of the workpiece W machined by the tool T. Disclosed is an abnormality diagnosis method for a machine tool, in which machine tool data and machining command values (machining conditions) set by the NC control unit 54 are transmitted from the data transmission device 51 to the data reception device 52, and the data processing device 53 performs abnormality diagnosis. It is

An object of the present invention is to provide an information processing apparatus, an information processing method, and a program capable of efficiently and accurately determining abnormality of a target portion.

An information processing apparatus according to the present invention includes a detection information acquisition unit that acquires detection information of a physical quantity that changes according to an operation of a target portion, an image information acquisition unit that acquires image information of the target portion, and normal data or abnormal data. A plurality of pieces of possibility information indicating the possibility of an abnormality in the target portion determined based on the model information and the detection information, image information , and operation information indicating the number of operations or operation time of the target portion are displayed on the display unit. a display control unit for displaying, on a display unit , the possibility information of each of the plurality of possibility information and the image information of each of the plurality of image information in association with each of the plurality of pieces of operation information ; and a model information updating unit for updating the model information based on detection information associated with the part of the motion information received by the receiving unit. Prepare.

ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus, information processing method, and program which can determine the abnormality of a target part efficiently and accurately can be provided.

It is a figure which shows an example of the system configuration|structure of the abnormality detection system which concerns on embodiment of this invention. It is a figure which shows the processing machine which concerns on this embodiment. It is a figure which shows an example of the hardware constitutions of an information processing apparatus. It is a figure which shows an example of the hardware constitutions of a processing machine. It is a figure showing an example of functional composition of an anomaly detection system concerning this embodiment. It is a figure which shows an example of a detailed functional structure of the signal processing part which concerns on this embodiment. 4 is a sequence diagram showing an example of storage processing of detection signals in the anomaly detection system according to the present embodiment; FIG. 4 is a conceptual diagram showing an example of a condition information management table according to this embodiment; FIG. 6 is a flow chart showing an example of signal processing for a detection signal in the information processing apparatus according to the embodiment; (a) is a diagram showing an example of a spectrogram of a detection signal during normal operation, and (b) is a diagram showing an example of a spectrogram of a detection signal during an abnormality. It is a conceptual diagram which shows an example of the detection signal management table which concerns on this embodiment. 4 is a flowchart showing an example of processing for image information in the information processing apparatus according to the embodiment; 4 is a conceptual diagram showing an example of an image information management table according to the embodiment; FIG. 6 is a flow chart showing an example of score display processing and model information storage processing in the information processing apparatus according to the present embodiment. It is a figure which shows an example of the output signal selection screen displayed on the information processing apparatus which concerns on this embodiment. 6 is a flowchart showing an example of display selection processing in the information processing apparatus according to the embodiment; It is a figure which shows an example of the display selection screen displayed on the information processing apparatus which concerns on this embodiment. 4 is a conceptual diagram showing an example of a model information management table according to the embodiment; FIG. It is a figure which shows an example of the display selection screen displayed on the information processing apparatus which concerns on the 1st modification of this embodiment. It is a figure which shows an example of the display selection screen displayed on the information processing apparatus based on the 2nd modification of this embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

●System Configuration FIG. 1 is a diagram showing an example of the system configuration of an anomaly detection system according to an embodiment of the present invention.

An abnormality detection system 1</b>A according to this embodiment includes a processing machine 70 and an information processing system 5 . The information processing system 5 includes a detection device 30 , an imaging device 40 and an information processing device 10 .

The processing machine 70 is an example of a processing unit that processes (processes) a workpiece, and the processing unit is an example of a target unit. The detection device 30 detects physical quantities that change according to the operation of the processing machine 70 . The imaging device 40 is an example of an imaging unit that captures a moving image or still image of the processing machine 70 .

The abnormality detection system 1</b>A may include a plurality of processing machines 70 , and may include a plurality of detection devices 30 corresponding to the plurality of processing machines 70 and a plurality of imaging devices 40 .

The information processing device 10 is a diagnostic device that is communicably connected to the processing machine 70 and that diagnoses an abnormality in the operation of the processing machine 70 . The information processing apparatus 10 may be a general-purpose PC (Personal Computer) in which a dedicated software program is installed. Further, the information processing apparatus 10 may be configured by a single computer, or may be configured by a plurality of computers.

The information processing device 10 and the processing machine 70 may be connected in any connection form. For example, the information processing apparatus 10 and the processing machine 70 may be connected by a dedicated connection line, a wired network such as a wired LAN (Local Area Network), or a wireless network.

The processing machine 70 is a machine tool that performs processing such as cutting, grinding, or polishing on a processing target (workpiece) using a tool. The processing unit is not limited to the processing machine 70, but is a machine capable of estimating an actual operation section that can be a diagnostic target, such as an assembling machine, a measuring machine, an inspection machine, or a cleaning machine. A machine may be the processor. It also includes any machine that includes an engine or motor as a power source, including clutches, gears, etc. Furthermore, the plurality of processing units do not necessarily have to be included in separate devices, and may be included in one device (processing system).

The detection device 30 detects vibrations or sounds generated by contact between a tool such as a drill, an end mill, a bit tip, or a grindstone installed in the processing machine 70 and a processing object during processing operation, or the tool or the processing machine 70 itself. It is a sensor that detects a physical quantity such as vibration or sound emitted by the sensor and outputs information of the detected physical quantity to the information processing device 10 as a detection signal (sensor data). The detection device 30 includes, for example, a microphone, a vibration sensor, an acceleration sensor, an AE sensor, or the like, and detects changes in physical quantities such as vibration or sound. These detection means are installed in the vicinity of tools that generate mechanical vibrations, such as drills, end mills, bit tips, and grindstones. The detection device 30 may be installed on an installation table or the like on the processing object side instead of on the tool side. The installation method is a method such as fixing with screws, fixing with a magnet, adhesion with an adhesive, or installation by drilling a hole or the like in the processing portion and embedding it therein. Further, the detection device 30 may not be fixed to the processing machine 70, and may be installed around the processing machine 70 so as to detect changes in physical quantities such as vibrations or sounds emitted by the processing machine 70. Just do it. Note that the number of detection devices 30 may be arbitrary. Moreover, a plurality of detection devices 30 that detect the same physical quantity may be provided, or a plurality of detection devices 30 that detect mutually different physical quantities may be provided.

Here, between the information processing device 10 and the detection device 30, several types of filters for filtering the output signal from the detection device 30 or filter selection means for selecting filters may be provided as required.

FIG. 2 is a diagram showing a processing machine according to this embodiment. A processing machine 70 includes a tool 50 and a detection device 30 , and a workpiece W is arranged below the tool 50 . In addition, the imaging device 40 is arranged at a position where the images of the tool 50 and the workpiece W can be captured. The tools 50 whose images are captured by the imaging device 40 are, for example, drills, reamers, taps, end mills, face mills, and cutting tools.

The detection device 30 may be pre-installed in the processing machine 70, or may be installed in the processing machine 70, which is a completed machine, afterward. Further, the detection device 30 is not limited to being installed in the vicinity of the processing machine 70, and may be installed on the information processing device 10 side.

The imaging device 40 can capture moving or still images of the tool 50 , the workpiece W, the spindle of the tool 50 , the entire range in which the tool 50 processes the workpiece W, the entire interior of the processing machine 70 , and the like. As a result, from the image of the tool 50 such as the cutting edge, the whole, the presence or absence of chips, etc., the processing state of the tool 50, such as deterioration, breakage, and chips, can be understood. I understand. In addition, from the image of the overall state of the processing machine 70, the machine environment at the time of abnormality can be known, and from the image of the turret containing the tool 50, the misuse of the tool 50 can be known in advance. From the coolant image, it can be seen whether the coolant is properly hitting the tool 50 or whether the coolant has run out.

●Hardware Configuration Next, hardware configurations of the information processing apparatus 10 and the processing machine 70 according to the present embodiment will be described with reference to FIGS. 3 and 4. FIG. Note that the hardware configurations shown in FIGS. 3 and 4 may have similar configurations in each embodiment, and components may be added or deleted as necessary.

◯Hardware Configuration of Information Processing Apparatus FIG. 3 is a diagram showing an example of the hardware configuration of the information processing apparatus according to the present embodiment.

The information processing apparatus 10 is constructed by a computer, and as shown in FIG. , an HDD (Hard Disk Drive) controller 105 , a display I/F 106 and a communication I/F 107 .

Among these, the CPU 101 controls the operation of the information processing apparatus 10 as a whole. The ROM 102 stores programs used to drive the CPU 101, such as an IPL (Initial Program Loader). A RAM 103 is used as a work area for the CPU 101 . The HD 104 stores various data such as programs. The HDD controller 105 controls reading or writing of various data to/from the HD 104 under the control of the CPU 101 . The display I/F 106 is a circuit for displaying an image on the display 106a. The display 106a is a type of display unit such as liquid crystal or organic EL that displays an image of a subject, various icons, and the like. A communication I/F 107 is an interface used for communication with an external device such as the processing machine 70 . The communication I/F 107 is, for example, a NIC (Network Interface Card) compatible with TCP (Transmission Control Protocol)/IP (Internet Protocol).

The information processing apparatus 10 also includes a sensor I/F 108 , a sound input/output I/F 109 , an input I/F 110 , a media I/F 111 and a DVD-RW (Digital Versatile Disk Rewritable) drive 112 .

A sensor I/F 108 is an interface that receives a detection signal via a sensor amplifier 302 included in the detection device 30 . The sound input/output I/F 109 is a circuit for processing input/output of sound signals between the speaker 109a and the microphone 109b under the control of the CPU 101. FIG. The input I/F 110 is an interface for connecting predetermined input means to the information processing apparatus 10 . . The keyboard 110a is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 110b is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The media I/F 111 controls reading or writing (storage) of data to a recording medium 111a such as a flash memory. The DVD-RW drive 112 controls reading or writing of various data to a DVD-RW 112a as an example of a removable recording medium. It should be noted that not only DVD-RW but also DVD-R or the like may be used. Also, the DVD-RW drive 112 may be a Blu-ray drive that controls reading and writing of various data on Blu-ray discs.

The information processing device 10 also includes a bus line 113 . A bus line 113 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 101 .

Recording media such as HDs and CD-ROMs in which each of the above programs is stored can be provided domestically or internationally as program products.

◯Hardware Configuration of Processing Machine◯ FIG. 4 is a diagram showing an example of the hardware configuration of the processing machine according to the present embodiment.

As shown in FIG. 4, the processing machine 70 includes a CPU 701, a ROM 702, a RAM 703, a display I/F 704, a communication I/F 705, a drive circuit 706, a sound output I/F 707, an input I/F 708, and a sensor I/F 709. ing.

Among these, the CPU 701 controls the operation of the processing machine 70 as a whole. The ROM 702 stores programs used to drive the CPU 701 such as IPL. A RAM 703 is used as a work area for the CPU 701 . A display I/F 704 is a circuit for displaying an image on the display 704a. The display 704a is a type of display unit such as liquid crystal or organic EL that displays an image of a subject, various icons, and the like.

A communication I/F 705 is an interface used for communication with an external device such as the information processing apparatus 10 . The communication I/F 705 is, for example, a NIC compatible with TCP/IP.

The drive circuit 706 is a circuit that controls driving of the motor 706a. The motor 706a drives the tool 50 used for processing. The tool 50 includes a drill, an end mill, a bit tip, a grindstone, etc., and a table on which the object to be processed is placed and moved according to the process.

The sound output I/F 707 is a circuit that processes sound signal output between the speaker 707a and the microphone 707b under the control of the CPU 701. FIG. The input I/F 708 is an interface for connecting predetermined input means to the processing machine 70 . The keyboard 708a is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 708b is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.

The processing machine 70 also includes a bus line 710 . A bus line 710 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 701 .

A detection device 30 for detecting a physical quantity such as vibration or sound output from the processing machine 70 includes a sensor 301 and a sensor amplifier 302 . As described above, the sensor 301 detects vibrations or sounds generated by the contact between the tool 50 installed in the processing machine 70 and the processing target during the processing operation, or vibrations or sounds generated by the tool 50 or the processing machine 70 itself. Detect physical quantities such as sound. Further, the sensor 301 acquires a detection signal (sensor data) based on information on the detected physical quantity. The sensor 301 is, for example, a microphone, vibration sensor, acceleration sensor, AE sensor, or the like. A sensor amplifier 302 adjusts the detection sensitivity of the sensor 301 and outputs a detection signal detected by the sensor 301 .

●Functional Configuration FIG. 5 is a diagram showing an example of the functional configuration of the anomaly detection system according to this embodiment.

◯ Functional Configuration of Information Processing Device ◯ First, the functional configuration of the information processing device 10 will be described. The functions realized by the information processing device 10 include a transmission/reception unit 11, a detection device communication unit 12, a reception unit 13, a display control unit 14, a sound control unit 15, a generation unit 16, a signal processing unit 17, a selection unit 18, and a determination unit. 21 , a storage/readout unit 19 , an imaging device control unit 41 and a storage unit 1000 .

The transmission/reception unit 11 has a function of transmitting/receiving various data (or information) to/from an external device such as the processing machine 70 . The transmitting/receiving unit 11 receives, for example, processing information (processing information) relating to the current operation of the processing machine 70 . Transmitting/receiving unit 11 is mainly implemented by communication I/F 107 and programs executed by CPU 101 shown in FIG. The transmission/reception unit 11 is an example of a processing information acquisition unit.

The detection device communication unit 12 has a function of performing data communication with the detection device 30 . The detecting device communication unit 12 receives, for example, a detection signal (sensor data) related to a physical quantity detected by the detecting device 30 . The detection device communication unit 12 is mainly realized by a program or the like executed by the CPU 101 shown in FIG. The detection device communication unit 12 is an example of a detection information acquisition unit that acquires detection information. Also, the detection signal received by the detection device communication unit 12 is an example of detection information related to a physical quantity that changes according to the operation of the processing unit.

The receiving unit 13 has a function of receiving user input to input means such as the keyboard 110a shown in FIG. The accepting unit 13 accepts selection of an output item, for example, according to an input on the output signal selection screen 200 (see FIG. 15). The reception unit 13 is mainly implemented by a program or the like executed by the CPU 101 shown in FIG.

The display control unit 14 has a function of displaying various screens on the display 106a shown in FIG. The display control unit 14 displays, for example, an output signal selection screen 200 (see FIG. 15) on the display 106a. Specifically, the display control unit 14 includes at least HTML (HyperText Markup Language), CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), for example, by starting and executing a software application that operates on the OS. ) etc. is downloaded. Then, the display control unit 14 causes the display 106a to display various image data generated by the WebAPP. The display control unit 14 displays, on the display 106a, image data generated by HTML5 including data in XML (Extensible Markup Language), JSON (Javascript Object Notation), SOAP (Simple Object Access Protocol) format, or the like. The display control unit 14 is mainly implemented by the display I/F 106 shown in FIG. 3 and a program executed by the CPU 101.

The sound control unit 15 has a function of outputting a sound signal from the speaker 109a shown in FIG. The sound control unit 15 sets a detection signal to be output from the speaker 109a, and causes the set detection signal to be acoustically output from the speaker 109a. The sound control unit 15 is mainly implemented by the sound input/output I/F 109 shown in FIG. 3 and a program executed by the CPU 101.

The generating unit 16 has a function of generating various image data to be displayed on the display 106a. The generator 16 generates, for example, image data relating to the output signal selection screen 200 (see FIG. 15) to be displayed on the display 106a. The generation unit 16, for example, renders data stored in the storage unit 1000 and generates image data for displaying the rendered data. Rendering is a process of interpreting data described in a Web page description language (HTML, CSS, XML, etc.) and calculating the layout of characters, image data, etc. actually displayed on the screen. Further, when processing information is received by the transmitting/receiving unit 11, the generation unit 16 generates a condition ID for identifying condition information including the received processing information. The generation unit 16 is mainly implemented by a program or the like executed by the CPU 101 shown in FIG.

The signal processing unit 17 has a function of performing signal processing on the detection signal received by the detection device communication unit 12 . A detailed description of the signal processing unit 17 will be given later. The signal processing unit 17 is mainly realized by a program or the like executed by the CPU 101 shown in FIG.

The selection unit 18 has a function of selecting a detection signal to be acoustically output based on a signal output request from a user. The selection unit 18 selects, for example, the detection signal stored in association with the condition information corresponding to the output item data included in the signal output request received by the reception unit 13 . The selection unit 18 is mainly implemented by a program or the like executed by the CPU 101 shown in FIG.

The judgment unit 21 is mainly realized by the processing of the CPU 101 shown in FIG. 3, and has a function of making various judgments. The determination unit 21 calculates, for example, differences in signal data related to the plurality of detection signals selected by the selection unit 18 . The determination unit 21 is an example of an abnormality determination unit.

The imaging device control unit 41 has a function of communicating control signals and image data with the imaging device 40 . The imaging device control unit 41 transmits an imaging start signal to the imaging device 40, for example. Further, the imaging device control unit 41 is an example of an image information acquisition unit that acquires image information of the processing machine 70, and for example, receives image information of a moving image or a still image of the processing machine 70 captured by the imaging device 40. . The imaging device control unit 41 is mainly implemented by a program or the like executed by the CPU 101 shown in FIG.

The storage/readout unit 19 has a function of storing various data in the storage unit 1000 or reading out various data from the storage unit 1000 . The storage/readout unit 19 is mainly implemented by a program or the like executed by the CPU 101 shown in FIG. Storage unit 1000 is mainly implemented by ROM 102, HD 104, and recording medium 111a shown in FIG.

In the storage unit 1000, a condition information management DB 1001, a detection signal management DB 1003, a model information management DB 1005, and an image information management DB 1007 are constructed. Of these, the condition information management DB 1001 is composed of a condition information management table, which will be described later. The detection signal management DB 1003 is composed of a detection signal management table which will be described later. The model information management DB 1005 is composed of a model information management table which will be described later. The image information management DB 1007 is composed of an image information management table, which will be described later. The storage/readout unit 19 is an example of a storage control unit.

◯ Functional Configuration of Detection Device ◯ Next, the functional configuration of the detection device 30 will be described. Functions realized by the detection device 30 include a device connection section 31 and a detection signal acquisition section 32 .

The device connection unit 31 has a function of transmitting the detection signal acquired by the detection signal acquisition unit 32 to the information processing device 10 . The device connection section 31 is mainly realized by the sensor amplifier 302 shown in FIG.

The detection signal acquisition unit 32 has a function of detecting a physical quantity such as vibration or sound that changes according to the operation of the processing machine 70 and acquiring information on the physical quantity as a detection signal. The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG. The detection signal acquisition unit 32 detects vibrations or sounds generated when a tool 50 such as a drill, an end mill, a bit tip, or a grindstone installed in the processing machine 70 contacts the processing object during processing operation, or the tool 50 or A physical quantity such as vibration or sound generated by the processing machine 70 itself is detected, and information on the detected physical quantity is acquired as detection information (sensor data). Output to For example, when the blade of the tool 50 used for processing is broken or chipped, the sound during processing changes. Therefore, the detection signal acquisition unit 32 detects acoustic data using the sensor 301 such as a microphone, and transmits a detection signal associated with the detected acoustic data to the information processing device 10 via the device connection unit 31 . The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG.

〇 Functional configuration of processing machine 〇 Next, the functions realized by the processing machine 70 are the transmission/reception unit 71 , the numerical control unit 72 , the drive control unit 73 , the drive unit 74 , the setting unit 75 , the reception unit 76 , and the display control unit 77 . and sound control unit 78 .

The transmitting/receiving unit 71 has a function of transmitting/receiving various data (or information) to/from an external device such as the information processing device 10 . The transmitting/receiving unit 71 transmits processing information related to the current operation of the processing machine 70 to the information processing device 10 . Transmitting/receiving unit 71 is mainly implemented by communication I/F 705 and programs executed by CPU 701 shown in FIG.

The numerical control unit 72 has a function of executing machining by the drive control unit 73 by numerical control (NC). For example, the numerical control section 72 generates and outputs numerical control data for controlling the operation of the driving section 74 . The numerical control unit 72 also outputs processing information related to the operation of the processing machine 70 to the transmission/reception unit 71 . The numerical control unit 72 , for example, sequentially transmits context information corresponding to the current operation of the processing machine 70 to the information processing device 10 via the transmission/reception unit 71 . The numerical control unit 72 changes the type of the drive unit 74 to be driven or the drive state (rotation speed, rotation speed, etc.) of the drive unit 74 according to the process of processing when processing the object to be processed. The numerical control unit 72 sequentially transmits context information corresponding to the changed type of motion to the information processing apparatus 10 via the transmitting/receiving unit 71 each time the type of motion is changed. The numerical control unit 72 is mainly realized by a program or the like executed by the CPU 701 shown in FIG.

The drive control section 73 has a function of driving and controlling the driving section 74 based on the numerical control data obtained by the numerical control section 72 . The drive control unit 73 is implemented by, for example, a drive circuit 706 shown in FIG. The drive control unit 73 is mainly realized by the drive circuit 706 shown in FIG. 4 and a program or the like executed by the CPU 701 .

The drive unit 74 is a function that is subject to drive control by the drive control unit 73 . The drive section 74 drives the tool under the control of the drive control section 73 . The drive unit 74 is an actuator driven and controlled by the drive control unit 73, and is mainly realized by a motor 706a shown in FIG. 23 and the like. It should be noted that the drive unit 74 may be any actuator as long as it is used for processing and subject to numerical control. Also, two or more drive units 74 may be provided.

The setting unit 75 has a function of setting condition information corresponding to the current operation of the processing machine 70 . The setting unit 75 is mainly implemented by a program or the like executed by the CPU 701 shown in FIG.

The receiving unit 76 has a function of receiving user input to input means such as the keyboard 708a shown in FIG. For example, the reception unit 76 receives selection of an output item according to an input to the output signal selection screen 200 (see FIG. 15) displayed on the display 704a. The reception unit 76 is mainly implemented by the input I/F 708 and the program executed by the CPU 701 shown in FIG.

The display control unit 77 has a function of displaying various screen information on the display 704a shown in FIG. The display control unit 77 displays, for example, the output signal selection screen 200 (see FIG. 15) on the display 704a. The display control unit 77 is mainly implemented by the display I/F 704 and the program executed by the CPU 701 shown in FIG.

The sound control unit 78 is realized by a command from the CPU 701 shown in FIG. 4, and has a function of outputting a sound signal from the speaker 707a. The sound control unit 78 sets a detection signal to be output from the speaker 707a, and causes the set detection signal to be acoustically output from the speaker 707a. The sound control unit 78 is mainly implemented by the sound output I/F 707 shown in FIG. 4 and a program executed by the CPU 701.

FIG. 6 is a diagram showing an example of a detailed functional configuration of the signal processing unit according to this embodiment. The signal processing section 17 shown in FIG. 6 includes an amplification processing section 171 , an A/D conversion section 172 , a feature amount extraction section 173 , a D/A conversion section 174 and a score calculation section 175 .

The amplification processing unit 171 has a function of amplifying the detection signal received by the detection device communication unit 12 . The amplification processing unit 171, for example, amplifies the analog signal received by the detection device communication unit 12 to an arbitrary magnitude. Also, the amplification processing unit 171 amplifies the digital signal converted by the A/D conversion unit 172 to an arbitrary magnitude, for example.

The A/D conversion unit 172 has a function of converting the analog signal amplified by the amplification processing unit 171 into a digital signal.

The feature amount extraction unit 173 has a function of extracting a feature amount (feature information) indicating the feature of the detection signal received by the detection device communication unit 12 . The feature amount may be any information as long as it indicates the feature of the detection signal. For example, when the detection signal is acoustic data, the feature quantity extraction unit 173 may extract energy, frequency spectrum, time, MFCC (Mel frequency cepstrum coefficient), or the like as the feature quantity.

The D/A conversion unit 174 has a function of converting the digital signal amplified by the amplification processing unit 171 into an analog signal.

The score calculation unit 175 calculates a score as an example of possibility information indicating the possibility of an abnormality in the processing machine 70 from the feature amount (for example, frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173 . The score calculation unit 175 is an example of a possibility information determination unit that determines possibility information indicating the possibility of an abnormality in the processing machine 70 .

◯Storage Processing of Detection Signals◯ FIG. 7 is a sequence diagram showing an example of storage processing of detection signals in the anomaly detection system according to the present embodiment.

In step S<b>11 , the transmission/reception unit 71 of the processing machine 70 transmits processing information related to the current operation of the processing machine 70 to the information processing device 10 forming the information processing system 5 . Specifically, the setting unit 75 of the processing machine 70 sets processing information indicating specific processing details when starting processing of a workpiece (processing target). The processing information is context information defined for each type of operation of the processing machine 70 as described above. Then, the transmission/reception unit 71 transmits the processing information set by the setting unit 75 to the information processing device 10 . Thereby, the transmission/reception unit 11 of the information processing device 10 receives the processing information transmitted from the processing machine 70 (an example of the processing information acquisition step).

In step S<b>12 , the generation unit 16 of the information processing device 10 generates a condition ID for identifying condition information including the processing information received by the transmission/reception unit 11 .

Then, in step S13, the storage/readout unit 19 stores and manages the condition information associated with the condition ID generated by the generation unit 16 and the processing information received by the transmission/reception unit 11 in the condition information management DB 1001. (An example of a memory control step). At that time, the storage/reading unit 19 also stores and manages the related ID given to the processing information indicating related processing in the condition information management DB 1001 . The condition information management DB 1001 stores and manages, in a condition information management table, processing information indicating specific details of processing to be executed by the processing machine 70 in association with each condition ID.

In step S<b>14 , the detection signal acquisition unit 32 of the detection device 30 that configures the information processing system 5 detects physical quantities such as vibration or sound generated by the processing machine 70 . Here, the detection signal acquisition unit 32 detects a sound generated by the processing machine 70 and acquires a detection signal (acoustic signal) related to the detected sound.

In step S<b>15 , the device connection unit 31 of the detection device 30 transmits the detection signal acquired in step S<b>14 to the information processing device 10 . Thereby, the detection device communication unit 12 of the information processing device 10 receives the detection signal transmitted from the detection device 30 (an example of the detection information acquisition step).

In step S<b>16 , the signal processing unit 17 of the information processing device 10 performs signal processing on the detection signal received by the detection device communication unit 12 .

In step S17, the storage/readout unit 19 of the information processing device 10 stores the signal data processed by the signal processing unit 17 in the detection signal management DB 1003 in association with the processing information transmitted from the processing machine 70 ( an example of a memory control step). For each condition ID generated in step S12, the information processing apparatus 10 obtains the processing number data included in the processing information received in step S11, the signal data related to the detection signal received in step S15, and the signal processing unit 17. The processed signal data (frequency data, score data) and the processing information data included in the processing information received in step S11 are associated and stored in the detection signal management table for management. The information processing apparatus 10 may store and manage processing time data in place of the number of processing times data.

That is, the storage/reading unit 19 stores the feature amount (frequency data) of each of the plurality of feature amounts in the detection signal management DB 1003 in association with the processing information of each of the plurality of processing information transmitted from the processing machine 70. Let

◯Condition Information Management Table FIG. 8 is a conceptual diagram showing an example of the condition information management table according to the present embodiment. In the storage unit 1000, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

The condition information management table shown in FIG. 8 is for managing processing information related to the operation of the processing machine 70 for each operation performed by the processing machine 70 . The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying condition information including processing information. The processing information is context information defined for each type of operation of the processing machine 70 . As shown in FIG. 8, the processing information includes the type of the tool 50 (identification information of the tool 50), the processing method (processing type) by the processing machine 70, the cumulative number of jobs after the start of the operation, contains information about the workpiece to be machined using Types of the tools 50 include, for example, drills, end mills, face mills, ball end mills, spot facing cutters, boring, bit tips, grindstones, and the like. Moreover, as a processing method, there are cutting and polishing. More specifically, machining methods include drilling, through drilling, woodworking, grooving, side milling, contour milling, ramping, deburring, and the like. Furthermore, the material to be processed includes an alloy, carbon resin, resin material, and the like. More specifically, the workpiece is represented by S50C (Japanese Industrial Standards (JIS)), FC250 (Japanese Industrial Standards (JIS)), S20CK (Japanese Industrial Standards (JIS)), etc., as shown in FIG. be.

Items included in the processing information further include user operation history information for the processing machine 70, the number of processing times included in one job (an example of the number of operations of the processing machine 70), identification information for the processing machine 70, It includes configuration information, such as the diameter and material of the tool 50, as well as information indicating the operational state of the tool 50. FIG. Among these, the information indicating the operation state of the tool 50 includes, for example, an ON/OFF signal (" ladder signal”), etc. Items included in the processing information include the cumulative usage time of the tool 50 (drive unit 74) from the start of use, the load on the tool 50 (drive unit 74), the number of rotations of the tool 50 (drive unit 74), the tool Information indicating processing conditions such as the processing speed of 50 (driving unit 74) may be included. Furthermore, the processing time (an example of the operation time of the processing machine 70) may be included, and the processing time may be included instead of the number of times of processing.

The condition information management table further stores and manages associated IDs for identifying related operations (processes) among the operations performed by the processing machine 70 . As for the related ID, the same related ID is given to the processing information indicating the related processing among the processing information included in the condition information management table. In the example of FIG. 8, the processing information identified by the condition ID; "A000001" and the condition ID; The processing information identified by "A000007" is given the same related ID "R002". Here, the related processing to which the related ID is assigned is, for example, processing in which the type of tool and the workpiece (target to be processed) are the same, but the number of jobs is different. Note that the process to which the related ID is assigned is not limited to this, and the related ID can be assigned to appropriately associate a plurality of processes according to user settings.

Next, processing of the detection signal by the signal processing unit 17 corresponding to step S16 in FIG. 7 will be described with reference to FIGS. 9 to 10. FIG.

FIG. 9 is a flowchart showing an example of signal processing for detection signals in the information processing apparatus according to this embodiment.

First, in step S<b>151 , when the detection signal is received (acquired) by the detection device communication unit 12 , the information processing device 10 shifts the process to step S<b>152 . On the other hand, the information processing device 10 repeats the process of step S<b>151 until the detection signal is received (acquired) by the detection device communication unit 12 .

In step S152, the amplification processing unit 171 of the signal processing unit 17 amplifies the detection signal received (acquired) by the detection device communication unit 12 and amplifies the detection signal to an arbitrary magnitude. In step S153, the A/D converter 172 of the signal processor 17 converts the analog signal amplified by the amplification processor 171 into a digital signal.

In step S154, the feature amount extraction unit 173 of the signal processing unit 17 performs a process of extracting a feature amount (feature information) indicating the feature of the digital signal converted by the A/D conversion unit 172 (feature amount extraction step). One case). Specifically, the feature quantity extraction unit 173 extracts the frequency spectrum included in the digital signal converted by the A/D conversion unit 172 .

In step S<b>155 , the score calculation unit 175 of the signal processing unit 17 calculates a score indicating the possibility of abnormality of the processing machine 70 from the feature amount (for example, frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173 .

Specifically, the score calculation unit 175 calculates the likelihood that the feature information of the detection information is normal, and calculates the likelihood that the feature information of the detection information is normal. It is calculated using the information, and the reciprocal of the likelihood is calculated as the score.

The score calculation unit 175 may calculate the score by ranking it step by step, or may calculate it with binary values of 0 and 1. The score calculator 175 may accumulate the calculated scores.

Further, the score calculation unit 175 calculates the likelihood indicating the likelihood that the feature information of the detection information is abnormal as a score using the model information of the feature information indicating abnormal data stored in the model information management DB 1005. You may

Here, the frequency component of the detection signal detected during operation of the processing machine 70 corresponding to step S154 in FIG. 9 will be described.

FIG. 10(a) shows a spectrogram of detection signals detected during normal processing in the processing operation of the processing machine 70, and FIG. 10(b) shows the processing operation of the processing machine 70, Fig. 4 shows a spectrogram of a detection signal detected when an anomaly is occurring; As shown in FIG. 10(b), when an abnormality occurs during the processing operation of the processing machine 70, a frequency component appears near 30000 Hz.

Then, in the score calculation step shown in step S155 in FIG. 9, for example, when the spectrogram shown in FIG. The likelihood that the spectrogram of the detection signal is abnormal is calculated as a score, depending on how many frequency components around 30000 Hz are included.

O Detection Signal Management Table FIG. 11 is a conceptual diagram showing an example of the detection signal management table according to the present embodiment. In the storage unit 1000, the detection signal management DB 1003 described in step S17 of FIG. 7 is configured by a detection signal management table as shown in FIG.

The detection signal management table shown in FIG. 11 is for managing the detection signal transmitted from the detection device 30 in association with the processing information transmitted from the processing machine 70 . The detection signal management table contains, for each condition ID, processing frequency data transmitted from the processing machine 70, detection signals, frequency data extracted by the feature amount extraction unit 173, score data calculated by the score calculation unit 175, and processing frequency data. The processing information data for each number of times of processing transmitted from the machine 70 is associated and stored and managed. The condition ID is identification information for identifying condition information included in the condition information management table shown in FIG. As a result, for each condition ID, the signal data (detection signal) is stored in association with related data (processed signal data (frequency data, score data), processing number data, and processing information data for each processing number). . In the detection signal management table, processing time data and processing information data for each processing time may be stored and managed in place of the processing number data and processing information data for each processing count.

FIG. 12 is a flowchart showing an example of processing for image information in the information processing apparatus according to this embodiment.

The information processing apparatus 10 includes an imaging device 40 that captures an image of the processing machine 70, but there is a problem in terms of efficiency when determining an abnormality of the processing machine 70 based on image information.

That is, in order to make an abnormality judgment based on image information, it is necessary to store a huge amount of image information including normal images, and image processing for making an abnormality judgment takes a huge amount of time. In the case of a processing machine, in order to capture an image with high accuracy, it is necessary to temporarily stop the operation of the processing machine in order to remove noise such as coolant, which poses a problem in terms of productivity.

On the other hand, if the frequency of imaging by the imaging device 40 is reduced in order to improve the efficiency of abnormality determination based on image information, there is a risk that an image showing the essential abnormal state cannot be obtained, and the accuracy of abnormality determination decreases.

In view of the above problems, an object of the present embodiment is to provide an information processing apparatus 10 capable of efficiently and accurately determining abnormality of the processing machine 70 .

The imaging device control unit 41 of the information processing device 10 determines whether the score calculated by the score calculation unit 175 is equal to or greater than the threshold (step S21).

If the imaging device control unit 41 determines in step S21 that it is equal to or greater than the threshold, it transmits an imaging start signal for starting imaging to the imaging device 40 (step S22, an example of an imaging control step). That is, the imaging device control section 41 controls the imaging device 40 based on the score calculated based on the detection signal. On the other hand, if the image pickup device control section 41 determines that it is less than the threshold in step S21, it ends the process.

Note that the information processing device 10 causes the imaging device 40 to start imaging at a timing that is not related to the score calculated by the score calculation unit 175, and the imaging device control unit 41 causes the score calculated by the score calculation unit 175 to be greater than or equal to the threshold value. , the timing of transmitting an imaging end signal for ending imaging to the imaging device 40 may be delayed.

After step S22, the imaging device control unit 41 acquires the image data of the moving image or the still image captured by the imaging device 40 from the imaging device 40 (step S23, an example of the image information acquisition step).

The storage/reading unit 19 of the information processing device 10 stores the image data of the moving image or the still image acquired by the imaging device control unit 41 in the detection signal management DB 1003 in association with the processing information transmitted from the processing machine 70. (Step S24).

The information processing apparatus 10 manages the image data of moving images or still images in association with the number of processing times data included in the processing information received in step S11 for each condition ID generated in step S12 shown in FIG. Store and manage in a table. The information processing apparatus 10 may store and manage processing time data in place of the number of processing times data.

The score calculation unit 175 of the signal processing unit 17 of the information processing device 10 obtains an example of second possibility information indicating the possibility of an abnormality in the processing machine 70 from the image data of the moving image or the still image acquired by the imaging device control unit 41. A second score is calculated as (step S25).

Specifically, the score calculation unit 175 calculates the likelihood indicating the likelihood that the image data is normal using the model information indicating normal data stored in the model information management DB 1005 of the storage unit 1000. , the reciprocal of the likelihood is calculated as the second score.

The score calculation unit 175 may calculate the second score by ranking it step by step, or may calculate it as a binary value of 0 and 1.

Further, the score calculation unit 175 may calculate the likelihood indicating the likelihood that the image data is abnormal as a second score using model information indicating abnormal data stored in the model information management DB 1005. good.

The determination unit 21 of the information processing device 10 determines whether the second score calculated by the score calculation unit 175 is equal to or greater than the threshold (step S26), and determines that the processing machine 70 is abnormal when it is determined to be equal to or greater than the threshold. (Step S27). That is, the determination unit 21 determines abnormality of the processing machine 70 based on the score and the second score indicating the possibility of abnormality of the processing machine 70 determined based on the image information.

When the information processing apparatus 10 determines that the processing machine 70 is abnormal, the information processing apparatus 10 uses the display 106a, the speaker 109a, or the like to output an alarm by display or sound.

As described above, the information processing apparatus 10 includes the imaging device control unit 41 that acquires image information of the processing machine 70 captured by the imaging device 40. The imaging device control unit 41 controls the imaging device based on the detection signal. control 40;

Accordingly, the information processing apparatus 10 can determine the timing of acquiring the image information of the processing machine 70 based on the detection signal, so that the image information of the processing machine 70 can be efficiently acquired.

The imaging device control unit 41 controls the imaging device 40 based on the score indicating the possibility of abnormality of the processing machine 70 determined based on the detection signal.

Thereby, the information processing apparatus 10 can efficiently acquire the image information of the processing machine 70 when the possibility of abnormality in the processing machine 70 is high based on the score.

The information processing apparatus 10 includes a determination unit 21 that determines abnormality of the processing machine 70 based on the score and image information. Specifically, the determination unit 21 determines abnormality of the processing machine 70 based on the score and a second score indicating the possibility of abnormality of the processing machine 70 determined based on the image information.

As described above, the information processing apparatus 10 can efficiently and accurately determine the abnormality of the processing machine 70 .

FIG. 13 is a conceptual diagram showing an example of an image information management table according to this embodiment.

In the storage unit 1000, the image information management DB 1007 described with reference to FIG. 5 is configured by an image information management table as shown in FIG.

The image information management table shown in FIG. 13 is for managing image data of moving images or still images acquired by the imaging device control unit 41 .

The image information management table stores and manages the processing frequency data and the moving image or still image data transmitted from the processing machine 70 in association with each condition ID. The condition ID is identification information for identifying condition information included in the condition information management table shown in FIG. The image information management table may store and manage processing time data instead of the number of processing times data.

Here, the detection signal management table shown in FIG. 11 includes, for each condition ID, signal data (detection signal), related data (processed signal data (frequency data, score data), processing frequency data, and processing information data), and the condition IDs stored and managed by the detection signal management table are common to the condition IDs stored and managed by the image information management table.

Therefore, the information processing apparatus 10 has both the detection signal management table shown in FIG. 11 and the image information management table shown in FIG. signal) and related data (processed signal data (frequency data, score data), processing frequency data, and processing information data for each processing frequency) are stored in association with each other.

Display Processing of Signal Data and Storage Processing of Model Information FIG. 14 is a flowchart showing an example of display processing of scores and storage processing of model information in the information processing apparatus according to the present embodiment.

In step S31, the display control unit 14 of the information processing apparatus 10 displays the output signal selection screen 200 on the display 106a. Specifically, the display control unit 14 causes the output signal selection screen 200 to be displayed when the reception unit 13 receives an input to a predetermined input screen displayed on the display 106a.

In step S<b>32 , when the user inputs the output item, the receiving unit 13 receives a signal selection request including the input output item data.

In step S33, the information processing apparatus 10 executes score display processing and signal data selection processing to be stored as model information based on the output item data received by the reception unit 13 (an example of a selection step).

In step S34, the storage/readout unit 19 stores the selected signal data in the model information management DB 1005 as model information.

FIG. 15 is a diagram showing an example of an output signal selection screen displayed on the information processing apparatus according to this embodiment.

FIG. 15 is a diagram showing an example of an output signal selection screen displayed on the information processing device, corresponding to steps S31 and S32 of the flowchart shown in FIG. The output signal selection screen 200 shown in FIG. 15 is a display screen for allowing the user to select a score to be displayed and signal data to be stored as model information. The output signal selection screen 200 includes an output item selection area 210 for specifying the score to be displayed and the detection signal to be stored as model information, a "VIEW" button 225 for displaying the score, and a button 225 for stopping processing. "CANCEL" button 203 is included.

Here, in the output item selection area 210, data of various items included in the processing information can be selected. The output item selection area 210 includes, for example, a tool selection area 211 in which the tool 50 (driving unit 74) can be selected, a workpiece selection area 212 in which the workpiece (processing target) can be selected, and a machining method can be selected. A machining method selection area 213 and a machining number selection area 214 in which the machining number can be selected are included. In the example of FIG. 15, the receiving unit 13 outputs tool; "drill (φ1 mm)", workpiece; "FC250 (Japanese Industrial Standards (JIS))", processing method; ; Accept the "first" data. Note that the items corresponding to the selection areas included in the output item selection area 210 are not limited to this, and may be appropriately added and changed according to the items indicated in the processing information. data may be accepted as selectable.

By pressing the "VIEW" button 225 shown in FIG. 15, the signal data selected in the output item selection area 210 is displayed.

14 and 15 described above, an example in which the output signal selection screen 200 is displayed on the information processing apparatus 10 and the user selects the detection signal to be output has been described. A configuration may be used in which the detection signals are displayed so that the user can select the detection signal to be output. 14 and 15, an example using the number of times of processing has been described, but the same applies to the case of using the processing time instead of the number of times of processing.

FIG. 16 is a flowchart showing an example of display selection processing in the information processing apparatus according to this embodiment. FIG. 16 is a flow chart showing an example of display selection processing corresponding to step S33 of the flow chart shown in FIG.

In step S331, the selection unit 18 selects the processing information corresponding to the output item data accepted in step S32 shown in FIG. 14 from among the processing information stored in the condition information management table shown in FIG. Specifically, the storage/reading unit 19 reads out the condition information management table from the condition information management DB 1001 . Then, the selecting unit 18 selects condition information including processing information corresponding to the output item data received by the receiving unit 13 from the condition information included in the read condition information management table. In this case, the selection unit 18 selects, for example, the condition information with the condition ID "A000001", which is the processing information corresponding to the output item data input to the output item selection area 210 shown in FIG.

In step S332, the selection unit 18 selects the signal associated with the same condition ID as the condition ID associated with the processing information selected in step S331 among the data stored in the detection signal management table shown in FIG. Select data and related data. Specifically, the storage/reading unit 19 reads the detection signal management table from the detection signal management DB 1003 . Then, the selection unit 18 selects signal data and related data associated with the condition ID included in the selected condition information from the data included in the read detection signal management table. In this case, the selection unit 18 selects, for example, the signal data and related data associated with the condition ID; "A000001".

In step S333, the selection unit 18 selects the image associated with the same condition ID as the condition ID associated with the processing information selected in step S331 among the data stored in the image information management table shown in FIG. Select data. Specifically, the storage/readout unit 19 reads out the image information management table from the image information management DB 1007 . Then, the selecting unit 18 selects image data associated with the condition ID included in the selected condition information from among the data included in the read image information management table. In this case, the selection unit 18 selects the image data associated with the condition ID; "A000001", for example.

In step S334, the display control unit 14 of the information processing apparatus 10 displays the information display selection screen 250 on the display 106a. Then, the display control unit 14 causes the information display selection screen 250 to display the signal data and related data selected in step S332 and the image data selected in step S333 in association with each other via the condition ID.

In step S335, when the user selects a section on the information display selection screen 250, the reception unit 13 receives selection of the section (an example of a reception step).

In step S336, the selection unit 18 selects the signal data and related data related to the section selected in step S335 from among the signal data and related data selected in step S332.

FIG. 17 is a diagram showing an example of an information display selection screen displayed on the information processing apparatus according to this embodiment.

FIG. 17 is a diagram showing an example of an information display selection screen displayed on the information processing apparatus, corresponding to steps S334 and S335 of the flowchart shown in FIG. The information display selection screen 250 shown in FIG. 17 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and selecting a specific section of the detection signal.

The user can confirm the possibility of an abnormality in the processing machine 70 by confirming the score displayed on the information display selection screen 250, but in order to actually determine that there is an abnormality, it is necessary to visually confirm the tools and the like. There was a problem in terms of accuracy of abnormality judgment.

Image data of the processing machine 70 is displayed on the information display selection screen 250 in order to visually confirm tools and the like. Have difficulty. Therefore, it is conceivable that the information processing apparatus 10 performs image processing on the image data to determine abnormality, but this requires storing a huge amount of image information, and it takes an enormous amount of time to determine abnormality by image processing. Therefore, there is a problem in terms of efficiency.

In view of the above problems, an object of the present embodiment is to provide an information processing apparatus 10 capable of efficiently and accurately determining abnormality of the processing machine 70 . .

On the information display selection screen 250, the processing frequency data related to the related data selected by the selection unit 18 is displayed in order of the processing frequency so that the user can check it.

Further, on the information display selection screen 250, a frequency spectrogram and score data as an example of a feature amount related to the related data selected by the selection unit 18, and user operation history data as an example of processing information data for each number of times of processing are displayed. , are associated with the number of times of processing data, respectively, and displayed in a state that the user can check them continuously. Also, the image data A is displayed in a state that the user can check in association with the score of the maximum value.

That is, the display control unit 14 causes the information display selection screen 250 of the display 106a to display a plurality of the number of processing times, the frequency spectrum, the operation history information, and the score. The frequency spectrum of each frequency spectrum, the operation history information of each of the plurality of operation history information, the score of each of the plurality of scores, and the image information are displayed on the information display selection screen 250 (an example of the display step). In the example of FIG. 17, the display control unit 14 connects a plurality of scores and displays them as a line graph, and displays image information in association with the position of the line graph showing the plurality of scores in the horizontal axis direction. there is

Further, the display control unit 14 displays the image information on the information display selection screen 250 in association with the maximum score among the plurality of scores. Here, the maximum value score is a score equal to or higher than the threshold described in step S21 of FIG.

Further, the information display selection screen 250 includes an input area 222 for inputting a processing number section as a specific section, an "OK" button 251 to be pressed when performing section selection processing, and an "OK" button 251 for canceling section selection processing. A "CANCEL" button 253 to be pressed is included.

As shown in FIG. 17, among the scores for the number of processing times 1001 to 1250, the score increases after the number of processing times 1230, and the score near the number of processing times 1250 is the highest.

Here, on the information display selection screen 250, the image data A of the tool is displayed in association with the score, and the user confirms the image data A of the tool corresponding to the score of the maximal value near the machining number of 1250. be able to.

In the example of FIG. 17, the image data of the tool contains a larger amount of chips than usual, so the user can determine that the reason for the high score is the chips.

That is, by confirming the score and the image information associated with the score, it is possible to accurately determine whether the processing machine 70 is abnormal.

Note that the image data may be displayed in association with not only the score of the maximum value, but also in association with all of the plurality of scores equal to or greater than the threshold described in step S21 of FIG. In that case, displaying all the image data at the same time would make the screen cumbersome, so among the image data associated with each of the multiple scores, only the image data associated with the score selected with a mouse or the like should be displayed. is preferred. Moreover, when the change in the score is large, the image data may be displayed in association with the score before, after, or before and after the change.

Further, FIG. 17 shows an example of selecting normal data from data of 1001 to 1250 processing times. Looking at the score as an example of the score data, it can be seen that the value is low from 1001 to 1230 times of processing. If the system automatically sets ``a portion with a small score is normal'' or ``a cycle with a young cycle (for example, 1001 to 1105) is normal'', this interval can be selected as normal data.

However, looking at the frequency data in the section from 1001 to 1230 times of processing, it can be seen that there is noise in the low frequency range. On the other hand, looking at the frequency data in the section from 1105 to 1207 of the number of processing times, it can be seen that there is no noise in the low frequency range, unlike in the section from 1001 to 1230 of the processing number.

Therefore, the user can appropriately determine that the data in the section of the number of processing times 1001 to 1230, which is a part of the number of processing times of 1001 to 1230, is more suitable as normal data than the data in the section of the number of processing times of 1001 to 1230.

Furthermore, looking at the user operation history in the section from 1001 to 1230 of the number of times of processing, it can be seen that an override has been performed. An override is an operation that temporarily changes the feed rate of a machine tool. It can be seen that the above-described low-frequency noise occurs in the override execution section. This is thought to be due to abnormal vibrations such as chatter caused by changing the feed rate. From this, it can be determined that the override execution section is not suitable for selection of normal data. Therefore, the user can more appropriately determine that the number of machining times 1105 to 1207 in which no override is performed is suitable as normal data.

Then, when the user inputs "1105 to 1207" in the input area 222 and presses the "OK" button 251, the reception unit 13 receives selection of "number of times of processing 1105 to 1207". As a result, detection signals or frequency spectra corresponding to "processing times 1105 to 1207", which are part of the processing times 1001 to 1230, can be appropriately set as normal data.

In addition, since the information "number of processing times 1105 to 1207" received by the receiving unit 13 is displayed in the input area 222, the user can check the content displayed in the input area 222 while checking "number of times of processing 1105 to 1207". 1207' can be reliably set as normal data.

In the above description, when "1105 to 1207" is input in the input area 222 and the "OK" button 251 is pressed, the reception unit 13 receives the selection of "number of times of processing 1105 to 1207". From the displayed frequency data, score, and user operation history, by selecting the portion of "processing times 1105 to 1207" with a mouse or the like and pressing the "OK" button 251, the reception unit 13 displays "processing times 1105 to 1207” may be accepted.

As described above, the information processing apparatus 10 associates the score indicating the possibility of abnormality of the processing machine 70 determined based on the detection signal with the image information, and displays the display on the information display selection screen 250 of the display 106a. A control unit 14 is provided.

Accordingly, by checking the image information in association with the score, the user can more accurately determine the abnormality of the processing machine 70 than when checking only the score. In addition, the user can more efficiently determine whether there is an abnormality in the processing machine 70 as compared with the case where only the image information is checked. That is, the user can efficiently and accurately determine the abnormality of the processing machine 70 by using the information processing apparatus 10 according to the present embodiment.

The display control unit 14 displays a plurality of frequency spectra of the detection signal on the information display selection screen 250, and selects each of the plurality of frequency spectra for information display in association with each of the plurality of processing frequencies. displayed on the screen 250.

Thereby, the user associates each score of the plurality of scores, confirms the number of processing times of each of the plurality of processing times, the frequency spectrum of each of the plurality of frequency spectra, and the image information, thereby obtaining the plurality of scores. Abnormality of the processing machine 70 can be determined efficiently and accurately for each score.

The display control unit 14 displays a plurality of pieces of operation history information on the information display selection screen 250, and selects and displays the operation history information of each of the plurality of operation history information in association with each of the plurality of processing times. displayed on the screen 250.

As a result, the user can confirm the processing count of each of the plurality of processing counts, the operation history information of each of the plurality of operation history information, and the image information in association with each score of the plurality of scores. Abnormality of the processing machine 70 can be determined efficiently and accurately for each of the plurality of scores.

The information processing apparatus 10 includes a receiving unit 13 that receives inputs of a plurality of processing counts in a plurality of processing counts.

Thereby, the user can confirm the score and the image information associated with the score on the display 106a, and then input a plurality of partial processing frequency reports for the plurality of processing frequencies. Therefore, each frequency spectrum of the plurality of frequency spectra corresponding to each of the plurality of processing times can be appropriately set as normal data or abnormal data.

The information processing apparatus 10 causes the display control unit 14 to display the partial plurality of processing times received by the receiving unit 13 on the information display selection screen 250 . As a result, the user can confirm the input partial number of processing times, so that each frequency spectrum of the plurality of frequency spectra corresponding to each processing number of the part of the plurality of processing numbers is displayed as normal data. Alternatively, it can be reliably set as abnormal data.

Further, as described above, the information processing apparatus 10 includes the display control unit 14 for displaying image information on the information display selection screen 250 of the display 106a. The imaging device control unit 41 acquires the image information of the processing machine 70, and the imaging device control unit 41 controls the imaging device 40 based on the detection signal.

Accordingly, the information processing apparatus 10 can determine the timing of acquiring the image information of the processing machine 70 based on the detection signal, so that the image information of the processing machine 70 can be efficiently acquired. Further, by checking the image information on the information display selection screen 250, the user can accurately determine whether the processing machine 70 is abnormal. That is, the user can efficiently and accurately determine the abnormality of the processing machine 70 by using the information processing apparatus 10 according to the present embodiment.

The imaging device control unit 41 controls the imaging device 40 based on the score indicating the possibility of abnormality of the processing machine 70 determined based on the detection signal.

Thereby, the information processing apparatus 10 can efficiently acquire the image information of the processing machine 70 when the possibility of abnormality in the processing machine 70 is high based on the score.

The display control unit 14 causes the information display selection screen 250 to display the score. Accordingly, the user can accurately determine the abnormality of the processing machine 70 by checking the score and the image information on the information display selection screen 250 .

The display control unit 14 displays the image information on the information display selection screen 250 in association with the score. Accordingly, the user can accurately determine the abnormality of the processing machine 70 by confirming the score and the image information in the information display selection screen 250 in association with each other.

FIG. 18 is a conceptual diagram showing an example of a model information management table according to this embodiment. In the storage unit 1000, as described in step S34 of FIG. 14, a model information management DB 1005 configured by a model information management table as shown in FIG. 18 is constructed.

In the model information management table, the storage/readout unit 19 stores and manages a plurality of processing count data, detection signals, frequency data, and score data associated with each association ID.

Then, the storage/readout unit 19 stores and updates the detection signal and the frequency data associated with each of the partial processing numbers of the plurality of processing numbers received by the reception unit 13. .

In the example of FIG. 18, as the model information of the related ID "R001", the number of processing data received by the reception unit 13 described in FIG. , are stored and managed in association with score data. As a result, detection signals, frequency data, and score data corresponding to processing times 1105 to 1207, which are part of processing times 1001 to 1230, can be appropriately stored as normal data.

Note that the model information management table may store and manage a plurality of detection signals, frequency data, and score data associated with each association ID in chronological order without storing the processing count data. Further, without storing the frequency data and the score data in the model information management table, the processing of steps S154 and S155 in FIG. Data may be extracted and score data may be calculated.

As described above, the information processing apparatus 10 stores, in the storage unit 1000, the frequency spectrums of the plurality of frequency spectra associated with the respective processing counts of the partial plurality of processing counts received by the receiving unit 13. A storage/reading unit 19 for storing is provided.

Thereby, each frequency spectrum of the plurality of frequency spectra corresponding to each of the plurality of processing times can be appropriately stored as normal data or abnormal data.

As described in FIG. 9, the information processing device 10 determines a score based on a plurality of frequency spectra stored in the storage unit 1000 and a frequency spectrum indicating characteristics of the detection signal acquired by the detection device communication unit 12. A score calculation unit 175 is provided.

Here, as described with reference to FIG. 18, since the plurality of frequency spectra stored in the storage unit 1000 are updated, the information processing apparatus 10 can accurately determine the score indicating the possibility of abnormality of the processing machine 70. can be done.

FIG. 19 is a diagram showing an example of an information display selection screen displayed on the information processing apparatus according to the first modification of the embodiment.

On the information display selection screen 250, as in FIG. 18, a plurality of frequency spectrograms, score data, and user operation history data are associated with the number of processing data, respectively, and displayed in a state that the user can confirm. there is In addition, the image data is displayed in a state that the user can check in association with the score of the maximum value. In the example of FIG. 19, since there are two maximum score values, the image data A and B are displayed in association with the respective scores of the two maximum values. The image data A and B include image data A1 and B1 of the entire tool and image data A2 and B2 obtained by enlarging the tip of the tool.

That is, the display control unit 14 displays a plurality of scores and image information on the information display selection screen 250 of the display 106a, and displays each image information of the plurality of image information in association with each score of the plurality of scores. It is displayed on the information display selection screen 250 .

FIG. 19 shows an example of selecting abnormal data from the data of the number of times of processing 801-900. Looking at the score as an example of the score data, it can be seen that the values near the number of times of processing 840 and after the number of times of processing 865 are high. If the system automatically sets ``where the score is high as normal'', these two sections can be selected as abnormal data.

However, when looking at the frequency data immediately before the number of times of processing 840, it can be seen that the data is interrupted once. Also, it can be seen that the values of the frequency data appear in the same way as usual around the number of times of processing of 840. FIG. That is, since the score indicating the change in the frequency data increased due to the interruption of the frequency data, it is considered unlikely that an abnormality in processing occurred.

On the other hand, after 865 processing times, the frequency data shows abnormal vibrations in the low range, and it is highly likely that some abnormality occurred in the processing. Therefore, the user can appropriately determine that the data of the number of processing times 865 to 900, which are part of the number of processing times of 801 to 900, are more suitable as abnormal data than the data around the number of processing times of 840.

Furthermore, when looking at the user operation history immediately before the number of times of machining 840, it can be seen that the machine power source was turned from OFF to ON. It is considered that the reason why the score immediately after this is high is that the warm-up operation of the machine has an effect. On the other hand, after the number of times of processing 865, although there is no evidence of any particular operation by the user, the frequency data shows abnormal vibration in the low range, and there is a high possibility that some kind of abnormality occurred in processing. Therefore, the user can more appropriately determine that the data of the number of processing times 865 to 900, which are part of the number of processing times of 801 to 900, are more suitable as abnormal data than the data around the number of processing times of 840.

Then, the user compares the state of the tool indicated by the image data corresponding to the maximal score near the machining number 840 with the tool state indicated by the image data corresponding to the maximal score after the machining number 865. Therefore, it can be confirmed from the image data that the data of the number of processing times 865 to 900, which are part of the number of processing times of 801 to 900, are suitable as abnormal data.

That is, by confirming the score and the image information associated with the score, it is possible to accurately determine whether the processing machine 70 is abnormal.

Although FIG. 19 illustrates an example using the number of times of processing, the same applies to the case of using the processing time instead of the number of times of processing.

As described above, the display control unit 14 displays a plurality of scores and image information on the information display selection screen 250, and associates each score of the plurality of scores with the image information of each of the plurality of image information. is displayed on the information display selection screen 250 .

Thereby, the user can check the image information of each of the plurality of scores in association with each score of the plurality of scores, thereby accurately detecting the abnormality of the processing machine 70 for each score of the plurality of scores. can judge well.

The display control unit 14 causes a plurality of processing times to be displayed on the information display selection screen 250, and displays the scores of the plurality of scores and the scores of the plurality of image information in association with the processing times of the plurality of processing times. Image information is displayed on the information display selection screen 250 .

As a result, the user can check the processing count of each of the plurality of processing counts and the image information of each of the plurality of image information in association with each score of the plurality of scores. Abnormality of the processing machine 70 can be accurately determined for each score.

FIG. 20 is a diagram showing an example of an information display selection screen displayed on the information processing apparatus according to the second modification of the embodiment.

On the information display selection screen 250, a plurality of pieces of score data are displayed in association with the number of times of processing data so that the user can check them continuously. Also, as in FIG. 19, image data A and B are displayed in association with the respective scores of the two local maximum values, and the image data A and B are the image data A1 and B1 of the entire tool. , and image data A2 and B2 obtained by enlarging the tip of the tool.

FIG. 20 shows an example of selecting a plurality of abnormal data from the number of times of processing 801-900.
Looking at the score as an example of the score data, it can be seen that the score between the number of processing times 801 and 900 is higher in two places. If the system automatically sets ``where the score is high as normal'', these two sections can be selected as abnormal data.

However, here, it may be possible to determine that there is a completely different tendency by comparing the image data corresponding to these two scores. In this case, if the two different abnormal data are called abnormal 1 and abnormal 2 respectively, the user can judge them as different abnormal data.

In FIG. 20, an example using the number of times of processing has been described, but the same applies to the case of using the processing time instead of the number of times of processing.

●Summary●
As described above, the information processing apparatus 10 according to one embodiment of the present invention acquires a detection signal (an example of detection information) of a physical quantity that changes according to the operation of the processing machine 70 (an example of the target part). 12 (an example of a detection information acquisition unit), an imaging device control unit 41 (an example of an image information acquisition unit) that acquires image information of the processing machine 70, and the possibility of an abnormality in the processing machine 70 that is determined based on the detection signal. A display control unit 14 for displaying a score (an example of possibility information) indicating the likelihood and image information in association with each other on a display 106a (an example of the display unit) is provided.

Accordingly, by checking the image information in association with the score, the user can more accurately determine the abnormality of the processing machine 70 than when checking only the score. In addition, the user can more efficiently determine whether there is an abnormality in the processing machine 70 as compared with the case where only the image information is checked. That is, the user can efficiently and accurately determine the abnormality of the processing machine 70 by using the information processing apparatus 10 according to the present embodiment.

The display control unit 14 causes the display 106a to display a plurality of scores and image information, and causes the display 106a to display each image information of the plurality of image information in association with each score of the plurality of scores.

Thereby, the user can confirm the image information of each of the plurality of images in association with each score of the plurality of scores, thereby efficiently identifying the abnormality of the processing machine 70 for each score of the plurality of scores. It is possible to make accurate and accurate judgments.

The display control unit 14 causes the display 106a to display a plurality of pieces of operation information indicating the number of times of operation or the operation time of the processing machine 70, and associates the pieces of operation information with the respective pieces of the pieces of operation information, and displays the respective scores of the pieces of the plurality of scores. , to display the respective image information of the plurality of image information on the display 106a.

Accordingly, the user can confirm the motion information of each of the plurality of motion information and the image information of each of the plurality of image information in association with the score of each of the plurality of scores. Abnormality of the processing machine 70 can be determined efficiently and accurately for each score.

The display control unit 14 causes the display 106a to display a plurality of frequency spectra of the detection signal (an example of feature information indicating the features of the detection information), and also displays a plurality of frequency spectra in association with the respective motion information of the plurality of motion information. are displayed on the display 106a.

Thereby, the user associates each of the plurality of scores with the motion information of each of the plurality of motion information, the frequency spectrum of each of the plurality of frequency spectra, and the image information of each of the plurality of image information. By checking, the abnormality of the processing machine 70 can be accurately determined for each of the plurality of scores.

The information processing apparatus 10 further includes a transmission/reception unit 11 (an example of a processing information acquisition unit) that acquires operation history information (an example of processing information related to the operation of the target unit) indicating a user's operation history with respect to the processing machine 70, The display control unit 14 causes the display 106a to display a plurality of pieces of operation history information, and causes the display 106a to display each piece of operation history information in association with each piece of operation information of the pieces of operation information.

Thereby, the user can associate each score of the plurality of scores with motion information of each of the plurality of motion information, operation history information of each of the plurality of operation history information, and image of each of the plurality of image information. By checking the information, it is possible to efficiently and accurately determine the abnormality of the processing machine 70 for each of the plurality of scores.

The information processing apparatus 10 includes a reception unit 13 that receives input of some pieces of motion information in the pieces of motion information.

Thereby, the user can confirm the score and the image information associated with the score on the display 106a, and then input some pieces of action information in the pieces of action information. Therefore, each detection signal or frequency spectrum of the plurality of detection signals or frequency spectrums corresponding to each of the plurality of partial pieces of operation information can be appropriately set as normal data or abnormal data.

The information processing apparatus 10 causes the display control unit 14 to display some pieces of operation information received by the receiving unit 13 on the display 106a. As a result, the user can confirm a plurality of pieces of the inputted motion information, and therefore, a plurality of detection signals corresponding to the respective motion information of the plurality of portions of the motion information or detection signals of the frequency spectrum can be obtained. Alternatively, the frequency spectrum can be reliably set as normal data or abnormal data.

The information processing apparatus 10 stores, in the storage unit 1000, each frequency spectrum of the plurality of frequency spectra associated with each of the plurality of pieces of motion information received by the reception unit 13. 19 (an example of a memory control unit).

Thereby, each frequency spectrum of a plurality of frequency spectra corresponding to each piece of operation information of some pieces of operation information can be appropriately stored as normal data or abnormal data.

The information processing device 10 uses a score calculation unit 175 (score determination part)).

Thereby, the information processing apparatus 10 can accurately determine a score indicating the possibility of abnormality of the processing machine 70 .

● Supplement ●
The functions of each embodiment can be realized by a computer-executable program written in a legacy programming language such as assembler, C, C++, C#, Java (registered trademark), an object-oriented programming language, or the like. Programs to perform the functions of may be distributed over telecommunications lines.

Programs for executing the functions of each embodiment include ROM, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), flash memory, flexible disk, CD (Compact Disc) - Storing and distributing in device-readable recording media such as ROM, CD-RW (Re-Writable), DVD-ROM, DVD-RAM, DVD-RW, Blu-ray disc, SD card, MO (Magneto-Optical disc), etc. can also

Furthermore, part or all of the functionality of each embodiment can be implemented on a programmable device (PD), such as an FPGA (Field Programmable Gate Array), or can be implemented as an ASIC, and each embodiment Circuit configuration data (bit stream data) to be downloaded to the PD to realize the function of on the PD, HDL (Hardware Description Language) for generating circuit configuration data, VHDL (Very High Speed Integrated Circuits Hardware Description Language), It can be distributed on a recording medium as data described in Verilog-HDL or the like.

An information processing apparatus, an information processing method, and a program according to one embodiment of the present invention have been described so far, but the present invention is not limited to the above-described embodiment, and additions, modifications, or additions of other embodiments have been made. It can be changed within the range that a person skilled in the art can conceive, such as deletion, etc., and as long as the action and effect of the present invention are exhibited in any aspect, it is included in the scope of the present invention.

1A, 1C Anomaly detection system 5 Information processing system 10 Information processing device 11 Transmission/reception unit (an example of processing information acquisition unit)
12 detection device communication unit (an example of detection information acquisition unit)
18 selection unit 19 storage/readout unit (an example of a storage control unit)
21 judgment unit (an example of an abnormality judgment unit)
30 detection device 40 imaging device (an example of an imaging unit)
41 imaging device control unit (an example of an image information acquisition unit)
70 processing machine (an example of the target part)
106a display (an example of a display unit)
173 feature quantity extraction unit 175 score calculation unit (an example of the possibility information determination unit)
200 Output signal selection screen 250 Information display selection screen 1000 Storage unit

JP-A-2007-190628

Claims (9)

a detection information acquisition unit that acquires detection information of a physical quantity that changes according to the motion of the target unit;
an image information acquisition unit that acquires image information of the target portion;
Model information indicating normal data or abnormal data and possibility information indicating the possibility of an abnormality in the target portion determined based on the detection information, the image information, and an operation indicating the number of operations or the operation time of the target portion. are displayed on a display unit, and each of the plurality of possibility information and each of the plurality of image information are displayed in association with each of the plurality of pieces of operation information. a display control unit for displaying image information on the display unit;
a receiving unit that receives input of part of the plurality of pieces of motion information;
a model information update unit that updates the model information based on the detection information associated with the part of the motion information received by the reception unit;
An information processing device comprising: 2. The information processing apparatus according to claim 1 , wherein the display control unit causes the display unit to display the possibility information and the plurality of types of image information in association with each other. The display control unit causes the display unit to display a plurality of characteristic information indicating characteristics of the detection information,
3. The information processing apparatus according to claim 1, wherein the feature information of each of the plurality of feature information is displayed on the display unit in association with the motion information of each of the plurality of motion information. the feature information includes a frequency spectrum of the detection information;
4. The information processing apparatus according to claim 3 , wherein the display control unit causes the display unit to display each of the plurality of frequency spectra in association with each piece of operation information of the plurality of pieces of operation information. further comprising a processing information acquisition unit that acquires processing information related to the operation of the target unit;
The display control unit further causes the display unit to display a plurality of pieces of the processing information, and displays the processing information of each of the plurality of processing information on the display unit in association with the operation information of each of the plurality of pieces of operation information. 5. The information processing apparatus according to any one of claims 1 to 4 , wherein the information is displayed on. The processing information includes operation history information indicating a user's operation history with respect to the target part,
The display control unit causes the display unit to display a plurality of pieces of the operation history information, and displays the operation history information of each of the plurality of operation history information in association with the operation information of each of the plurality of pieces of operation information. 6. The information processing apparatus according to claim 5 , wherein the information is displayed on the unit. The display control unit
7. The information processing apparatus according to any one of claims 1 to 6, wherein said part of the operation information received by said reception unit is displayed on said display unit. a detection information acquisition step of acquiring detection information of a physical quantity that changes according to the motion of the target part;
an image information acquiring step of acquiring image information of the target portion;
Model information indicating normal data or abnormal data and possibility information indicating the possibility of an abnormality in the target portion determined based on the detection information, the image information, and an operation indicating the number of operations or the operation time of the target portion. are displayed on a display unit , and each of the plurality of possibility information and each of the plurality of image information are displayed in association with each of the plurality of pieces of operation information. a display step of displaying image information on the display unit;
a receiving step of receiving input of part of the plurality of pieces of motion information;
and a model information updating step of updating the model information based on the detection information associated with the part of the motion information received in the receiving step .

A program that causes a computer to execute the information processing method according to claim 8 .

Images