WO2021221030A1 - Quality determination system, quality determination method, server, and program - Google Patents

Abstract

The present invention provides a quality determination system capable of determining the quality of inspection targets with higher accuracy, a quality determination method, a server, and a program.　A quality determination system 10a comprises: a teaching dataset generation unit 302 that classifies images containing a plurality of inspection target defects in accordance with defect-characterizing brightnesses, and generates a plurality of classified teaching datasets; a storage unit 460b that stores a plurality of machine learning models, which have been respectively constructed on the basis of the plurality of teaching datasets by a machine learning model construction service 80 for constructing machine learning models; a camera unit 460a that captures images of inspection targets; a determination unit 460c that determines the quality of each inspection target 14 imaged by the camera unit 460a on the basis of the plurality of machine learning models stored in the storage unit 460b; and an optimal model selection unit 306 that evaluates the determination results from the determination unit 460c, and selects an optimal machine learning model from among the plurality of machine learning models.

Description

Pass / fail judgment system, pass / fail judgment method, server and program

The present invention relates to a pass / fail judgment system, a pass / fail judgment method, a server, and a program.

Patent Document 1 describes a service providing system that provides a service using machine learning by artificial intelligence. This service providing system is a service providing system that provides services using machine learning by artificial intelligence, and is a general model modeled by machine learning by inputting learning data based on information sent from users. A machine learning means for generating a model, a personalization means for personalizing the general model to a model suitable for the user based on the information sent from the user, and the personalized means. A service providing means for providing a personalized service to the user by using a model is provided, and the information sent from the user is used for both the machine learning and the personalization.

Patent Document 2 describes a visualization display method of a sound source position that visualizes the position of an arbitrary sound source in real time by associating it with a real space. This visualization display method detects one or more sounds, locates the position of each sound source, converts information about the sound source including at least the position of the sound source into visible information, and superimposes it on the actual image around the sound source in real time. It is characterized by displaying.

Japanese Unexamined Patent Publication No. 2016-48417 Japanese Unexamined Patent Publication No. 2004-77277

An object of the present invention is to provide a quality determination system, a quality determination method, a server and a program capable of determining the quality of an inspected object with higher accuracy.

The invention according to claim 1 is a teaching data group generation unit that classifies an image including a defect of a plurality of objects to be inspected according to the brightness that characterizes the defect and generates a plurality of classified teaching data groups. A storage unit that stores a plurality of the machine learning models constructed by the machine learning model construction service provided as a cloud computing service and constructing a machine learning model based on the plurality of teaching data groups, and the object to be inspected. A camera unit that captures the image of the above, a determination unit that determines the quality of the object to be inspected imaged by the camera unit based on the plurality of machine learning models stored in the storage unit, and the determination unit. This is a pass / fail judgment system including an optimum model selection unit that evaluates the result of the determination according to the above and selects the optimum machine learning model from the plurality of machine learning models.

The invention according to claim 2 is a teaching data group generation unit that classifies an image including a defect of a plurality of objects to be inspected according to a parameter that characterizes the defect and generates a plurality of classified teaching data groups. , A storage unit that stores a plurality of the machine learning models constructed based on the plurality of teaching data groups, a camera unit that captures an image of the object to be inspected, and the plurality of storage units stored in the storage unit. Based on the machine learning model, a determination unit for determining the quality of the object to be inspected, which is imaged by the camera unit, and a determination result by the determination unit are evaluated, and the optimum machine learning model is selected from the plurality of machine learning models. It is a pass / fail judgment system equipped with an optimum model selection unit for selecting a machine learning model.

The invention according to claim 3 is the process P1 in which the teaching data group generating unit obtains a feature value representing the brightness that characterizes the defect in the image in the quality determination system according to claim 1, respectively. The process P2 of classifying the plurality of images according to the feature values and generating the plurality of classified teaching data groups is performed.

The invention according to claim 4 is a plurality of criteria for the teaching data group generating unit to determine the brightness that characterizes the defect in the image in the quality determination system according to claim 1. From the values, a process P1 for obtaining a plurality of reference values representing the brightness characterizing the defect as feature values, and the same number of images as the number of the feature values are prepared, and the images are used as the plurality of images. Process P2, which classifies the data according to different feature values and generates the plurality of classified teaching data groups, is performed.

The invention according to claim 5 is a pass / fail determination method using the pass / fail determination system according to claim 1, wherein the teaching data group generation unit generates a plurality of teaching data groups, and the storage unit. However, the step of storing the plurality of machine learning models, the step of the determination unit determining the quality of the object to be inspected based on the plurality of machine learning models, and the step of the optimum model selection unit are described. A step of selecting the optimum machine learning model from a plurality of machine learning models, and a step of the determination unit determining the quality of the object to be inspected using the machine learning model selected by the optimum model selection unit. This is a pass / fail judgment method including.

The invention according to claim 6 determines the quality of the inspected object, respectively, based on a plurality of teaching data groups in which an image containing a defect in the plurality of inspected objects is classified according to the brightness that characterizes the defect. A server connected via a network to a cloud computing service that builds a plurality of machine learning models for determination and a determination device that determines the quality of the object to be inspected based on the plurality of machine learning models. The teaching data group generation unit that generates the plurality of teaching data groups and the result of the quality determined by the determination device are evaluated, and the optimum machine learning model is selected from the plurality of machine learning models. It is a server equipped with an optimum model selection unit.

The invention according to claim 7 determines the quality of the inspected object, respectively, based on a plurality of teaching data groups in which an image containing a defect in the plurality of inspected objects is classified according to the brightness that characterizes the defect. A computer connected via a network to a cloud computing service for constructing a plurality of machine learning models for determination and a determination device for determining the quality of the object to be inspected based on the plurality of machine learning models. , The teaching data group generating means for generating the plurality of teaching data groups, the optimum model that evaluates the result of the quality determined by the determination device, and selects the optimum machine learning model from the plurality of machine learning models. It is a program that functions as a means of selection.

The invention according to claim 8 is a server having a teaching data group generation unit and a teaching data group generating unit that generates a plurality of teaching data groups in which an image containing a defect of a plurality of objects to be inspected is classified according to the brightness that characterizes the defect. A cloud computing service that builds a plurality of machine learning models that determine the quality of the object to be inspected based on the plurality of teaching data groups, and an imaging unit that captures an image of the object to be inspected. The connected computer is imaged by the imaging unit based on a storage means for storing the plurality of machine learning models constructed by the cloud computing service and the plurality of machine learning models stored in the storage unit. This is a program that functions as a determination means for determining the quality of the object to be inspected.

The invention according to claim 9 has a detector for measuring a physical quantity that changes due to a sign that a defect of a monitored object occurs, and is a visualization device that generates a plurality of visualization images that visualize the physical quantity. A teaching data group generation unit that classifies the visualized image including a plurality of previously acquired defects according to the parameters that characterize the defects and generates a plurality of classified teaching data groups, and the plurality of teaching data. A storage unit that stores a plurality of the machine learning models constructed based on the group, an optimum model selection unit that selects the optimum model to be the optimum machine learning model from the plurality of machine learning models, and the visualization. A quality determination system including a plurality of visualization images generated by the apparatus and a determination unit for determining the quality of the operating state of the monitored object based on the optimum model selected by the optimum model selection unit. Is.

The invention according to claim 10 has a sound source visualization device that has a microphone for identifying a sound source generated from a monitored object and generates a plurality of sound source visualization images that visualize the sound source, and a plurality of previously acquired defects. The sound source visualization image including the above is classified according to the parameters that characterize the defect, and is constructed based on the teaching data group generation unit that generates a plurality of classified teaching data groups and the plurality of teaching data groups. A storage unit that stores a plurality of the machine learning models, an optimum model selection unit that selects the optimum model to be the optimum machine learning model from the plurality of machine learning models, and the sound source visualization device generated by the sound source visualization device. It is a quality determination system including a plurality of sound source visualization images and a determination unit for determining the quality of the operating state of the monitored object based on the optimum model selected by the optimum model selection unit.

The invention according to claim 11 has a vibration sensor for detecting vibration generated from a monitored object, a vibration visualization device that generates a plurality of vibration visualization images that visualize the vibration, and a plurality of previously acquired vibration visualization devices. The vibration visualization image including the defect is classified according to the parameters that characterize the defect, and is constructed based on the teaching data group generation unit that generates a plurality of classified teaching data groups and the plurality of teaching data groups. A storage unit that stores the plurality of the machine learning models, an optimum model selection unit that selects the optimum model to be the optimum machine learning model from the plurality of machine learning models, and a vibration visualization device are generated. It is a quality determination system including a determination unit for determining the quality of the operating state of the monitored object based on the plurality of vibration visualization images and the optimum model selected by the optimum model selection unit.

The invention according to claim 12 is a pass / fail determination method using the pass / fail determination system according to claim 9, wherein the visualization device generates the visualization image, and the teaching data group generation unit is described. The step of creating a plurality of teaching data groups, the step of storing the plurality of machine learning models by the storage unit, and the step of storing the plurality of machine learning models, and the optimum model selection unit select the optimum machine learning model from the plurality of machine learning models. This is a quality determination method including a step of selecting and a step in which the determination unit determines the quality of the operating state of the monitored object using the machine learning model selected by the optimum model selection unit.

The invention according to claim 13 is a plurality of teaching data groups in which a plurality of visualized images that visualize a physical quantity changed due to a sign that a defect to be monitored occurs are classified according to parameters that characterize the defect. Based on the cloud computing service that builds a plurality of machine learning models for determining the quality of the operating state of the monitored object, and the quality of the monitored object, respectively, based on the plurality of machine learning models. A server connected to the determination device via a network, the teaching data group generation unit that generates the plurality of teaching data groups, and the optimum machine learning model from the plurality of machine learning models. It is a server provided with an optimum model selection unit for selection.

The invention according to claim 14 is a plurality of teaching data groups in which a plurality of visualized images that visualize a physical quantity changed due to a sign that a defect to be monitored occurs are classified according to parameters that characterize the defect. Based on the above, a cloud computing service that builds a plurality of machine learning models for determining the quality of the operating state of the monitored object, and the quality of the monitored object, respectively, based on the plurality of machine learning models. The determination device and the computer connected to the determination device via a network are evaluated by the teaching data group generating means for generating the plurality of teaching data groups, the result of the quality determined by the determination device, and the plurality of machines. It is a program that functions as an optimal model selection means for selecting the optimal machine learning model from the learning models.

The invention according to claim 15 is a plurality of teaching data groups in which a plurality of visualized images that visualize a physical quantity changed due to a sign that a defect to be monitored occurs are classified according to parameters that characterize the defect. Based on, each is connected to a cloud computing service that builds a plurality of machine learning models for determining the quality of the operating state of the monitored object, and an imaging unit that captures an image of the object to be inspected. The computer is imaged by the imaging unit based on a storage means for storing the plurality of machine learning models constructed by the cloud computing service and the plurality of machine learning models stored in the storage unit. It is a program that functions as a judgment means for judging the quality of an inspected object.

According to the present invention, it is possible to provide a quality determination system, a quality determination method, a server and a program capable of determining the quality of an inspected object with higher accuracy.

It is a block diagram of the quality determination system which concerns on 1st Embodiment of this invention. It is explanatory drawing of the teaching data creation apparatus provided in the same quality determination system. It is explanatory drawing of the server provided in the same quality judgment system. It is explanatory drawing of the teaching data group generated by the same quality judgment system, and a plurality of machine learning models constructed by each of these teaching data groups. It is explanatory drawing of the image including the defect of the object to be inspected. It is explanatory drawing of the horizontal gray value profile graph which showed typically about a part of the scanning position. 6 is a horizontal gray value profile graph of image A schematically showing a part of scanning positions. 6 is a horizontal gray value profile graph of image B schematically showing a part of scanning positions. 6 is a horizontal gray value profile graph of image C schematically showing a part of scanning positions. It is explanatory drawing of the preprocessing by the same quality judgment system. It is explanatory drawing of the terminal and the image pickup part provided in the same quality determination system. It is a flow chart which shows the operation of the same quality judgment system. It is a block diagram of the quality determination system which concerns on 2nd Embodiment of this invention. It is explanatory drawing of the terminal and the image pickup part provided in the same quality determination system. It is a block diagram of the predictive maintenance system which concerns on 3rd Embodiment of this invention. It is explanatory drawing of the server provided in the predictive maintenance system. It is explanatory drawing of the terminal and the sound source visualization device provided in the predictive maintenance system. It is a flow chart which shows the operation of the predictive maintenance system. It is a block diagram of the predictive maintenance system which concerns on 4th Embodiment of this invention.

Subsequently, with reference to the attached drawings, an embodiment embodying the present invention will be described to help the understanding of the present invention. In the figure, parts not related to the description may be omitted.

[First Embodiment]
The quality determination system 10a (see FIG. 1) according to the first embodiment of the present invention can determine the quality of the appearance of the object to be inspected 14, which is a product manufactured by the user, by machine learning. The quality of this appearance is judged by the presence or absence of defects such as scratches and adhesion of foreign matter.
The object to be inspected 14 is, for example, a part of a transportation machine such as an automobile or an aircraft, and food. However, the object to be inspected 14 is not limited to these parts and foods.
The pass / fail judgment service by the pass / fail judgment system 10a is provided to the user by the service provider.

As shown in FIG. 1, the quality determination system 10a includes a teaching data creation device 20, a server 30, and an inspection system 40a.
The teaching data creation device 20, the server 30, and the inspection system 40a are connected to each other via the Internet N.

The teaching data creating device 20 is, for example, a personal computer. The teaching data creating device 20 is managed by a service provider or a user who uses the inspection system 40a, and has a teaching data creating unit 202 as shown in FIG.
The teaching data creating unit (an example of teaching data creating means) 202 acquires an image of the object to be inspected 14 from, for example, a camera 460 provided in the inspection system 40a, and is inspected as teaching data for constructing a machine learning model. An image of an object 14 can be created.
The teaching data creating device 20 functions as a teaching data creating means by a program executed by the teaching data creating device 20.
The teaching data creating device 20 may be a mobile terminal such as a smartphone.

The server 30 is managed by the service provider, and has a teaching data group generation unit 302, an optimum model selection unit 306, and a management unit 308, as shown in FIG.
As shown in FIG. 4, the teaching data group generation unit (an example of the teaching data group generation means) 302 is an image IMG1, IMG2, IMG3, of an inspected object 14 containing a plurality of different defects created by the teaching data creation device 20. By preprocessing (teaching data group TD), a set of preprocessed teaching data groups TDg, that is, teaching data groups TD1, TD2, TD3, TD4, ... Is created.

Here, when each image IMG1, IMG2, IMG3, ... Of the object 14 to be inspected including the defect D centered on the position (Xd, Yd) is imaged by a camera having 1.3 million pixels, for example, FIG. As shown, the size is 1024 px (Y-axis direction) in the vertical direction and 1280 px (X-axis direction) in the horizontal direction. This image is represented by a horizontal gray value profile graph as shown in FIG.
Here, the horizontal gray value profile graph is a graph in which pixels of an image are scanned in order and the brightness corresponding to the scanning position is shown, and the horizontal axis shows the scanning position and the vertical axis shows the brightness. The scanning direction of the pixels is, for example, the direction from the upper left to the right of the image (positive direction of the X-axis) as shown by the arrow in FIG. 5, and this is repeated in the downward direction (positive direction of the Y-axis). All pixels are scanned.

The horizontal gray value profile graph shown in FIG. 6 shows that the brightness of the defect D is brighter than that of the non-defect portion. However, the brightness of the defect D is not always brighter than that of the non-defect portion, and may be darker than that of the non-defect portion.
As described above, the brightness of the defect D specified in advance has a characteristic different from the brightness of the non-defect portion, and the defect D is distinguished from the non-defect portion and characterized by the brightness (an example of the parameter).
The horizontal gray value profile graph shown in FIG. 6 shows only a part of the scanning position (near the defect D), and the omitted range is shown by a broken line. The same applies to FIGS. 7A to 7C described later.

The pre-processing performed by the teaching data group generating unit 302 includes the following processing P1 and processing P2.
In the processing P1, as shown in FIG. 6, the teaching data group generation unit 302 uses the images IMG1, IMG2, IMG3, ... For TD), the brightness of the pixels that characterize the defect D whose position has been specified in advance is set to a reference value that serves as a reference for determining a plurality of thresholds (brightness ranges) having different predetermined sizes. Example) Compared with TH1 to TH10, this is a process of obtaining a plurality of threshold values included in the range of brightness of the pixels that characterize the defect D as feature values representing the brightness that characterizes the defect D.
In the processing P2, the teaching data group generating unit 302 transmits each image IMG1, IMG2, IMG3, ... (Teaching data group TD) according to the plurality of feature values obtained in the processing P1. It is a process of classifying into TD2, TD3, TD4, .... However, at that time, the teaching data group generation unit 302 does not classify one image into any one teaching data group TD1, TD2, TD3, TD4, ..., But copies the original image. Prepare the same number of images as the number of feature values, and classify them into teaching data groups TD1, TD2, TD3, TD4, ... Corresponding to each threshold value.
Therefore, by this preprocessing, as shown in FIG. 4, the teaching data groups TD1, TD2, TD3, TD4, ... Are generated from the teaching data group TD.

Next, specific examples of this pretreatment will be described based on images A, B, C ... Which are examples of images IMG1, IMG2, and IMG3 of the object 14 to be inspected, respectively.
The image A corresponding to the image IMG1 includes the defect D1 whose position is specified in advance as shown in FIG. 7A, and the range of brightness that characterizes the defect D1 is 155 to 205.
The image B corresponding to the image IMG2 includes the defect D2 whose position is specified in advance as shown in FIG. 7B, and the brightness range that characterizes the defect D2 is 165 to 215.
The image C corresponding to the image IMG3 includes the defect D3 whose position is specified in advance as shown in FIG. 7C, and the range of brightness that characterizes the defect D3 is 155 to 230.

In the above-described process P1, first, a plurality of threshold values (examples of reference values) 20, 40, 60, 80, 100, 120, 140, 160, 180, 200, 220, 240 are set, and image A (FIG. 7A). (See), three thresholds 160, 180, and 200 included in the brightness range 155 to 205 that characterize the defect D1 are obtained as feature values.

In the above-mentioned process P2, by copying the image A, the same number of images as the number of feature values, that is, three images A are prepared, and each image corresponds to the feature value 160 as shown in FIG. It is classified into the teaching data group TD1 corresponding to the teaching data group TD1, the teaching data group TD2 corresponding to the feature value 180, and the teaching data group TD3 corresponding to the feature value 200.

The above processes P1 and P2 are also performed on the remaining images B, C ...
That is, for image B (see FIG. 7B), two thresholds 180 and 200 included in the brightness range 165 to 215 that characterize the defect D2 are obtained as feature values, and image B corresponds to the feature value 180. It is classified into the teaching data group TD2 and the teaching data group TD3 corresponding to the feature value 200 (see FIG. 8).
For image C (see FIG. 7C), four thresholds 160, 180, 200, 220 included in the brightness range 155 to 230 that characterize the defect D3 are obtained as feature values, and image C is set to feature value 160. It is classified into the corresponding teaching data group TD1, the teaching data group TD2 corresponding to the feature value 180, the teaching data group TD3 corresponding to the feature value 200, and the teaching data group TD4 corresponding to the feature value 220 (see FIG. 8).
Further, with respect to the remaining images (images other than images A, B, and C) included in the teaching data group TD, the corresponding teaching data groups TD1, TD2, TD3, TD4, ... A set of teaching data groups TDg (see FIG. 4) is generated.

These teaching data groups TD1, TD2, TD3, TD4, ... Classified according to the brightness that characterizes the defect are machine learning models M1, M2, M3, M4 that determine the quality of the object 14 to be inspected, respectively. It is a teaching data group for constructing ...

In the preprocessing, the images IMG1, IMG2, IMG3, ... (Teaching data group TD) are classified into each teaching data group TD1, TD2, TD3, TD4, ... Based on the brightness. It is not limited, and may be classified based on parameters other than brightness. Parameters other than brightness include, for example, the hue, saturation, and lightness that make up the HSV color space, and the gradation-expressed R (Red) and G (Green) in the RGB color model. And B (Blue). That is, the parameters may be arbitrary as long as the defective portion can be characterized so as to be distinguished from the non-defective portion.
Further, as the pretreatment, a filter treatment for making the defective portion stand out more than the non-defective portion may be included.

Here, the machine learning model construction service 80 shown in FIGS. 1 and 4 is provided as a cloud computing service, and a trained machine learning model can be constructed based on the uploaded teaching data. This machine learning model construction service 80 is, for example, a Cloud AutoML Vision provided by Google Cloud Platform (GCP).

The optimum model selection unit (an example of the optimum model selection means) 306 (see FIG. 3) evaluates the quality judgment result of the object 14 to be inspected by a plurality of learned machine learning models constructed by the machine learning model construction service 80. , You can choose the best machine learning model.

The management unit (an example of management means) 308 can manage the state of the inspection system 40a used by the user. Specifically, the management unit 308 can record operation information regarding the operating state of the imaging unit 460 (see FIG. 1) included in the inspection system 40a. This operation information will be described later.

The server 30 functions as a teaching data group generation means, an optimum model selection means, and a management means by a program executed inside the server 30.

As shown in FIG. 1, the inspection system 40a includes a terminal 440, a PLC (Programmable Logic Controller) 450, and an imaging unit (an example of a determination device) 460 that images the object 14 to be inspected and determines the quality thereof. .. The terminal 440, the PLC 450, and the imaging unit 460 are connected to each other by wire communication or wireless communication.

The terminal 440 is managed by the user. The terminal 440 is, for example, a mobile terminal such as a personal computer or a smartphone, and may be a higher-level controller of the PLC 450.
As shown in FIG. 9, the terminal 440 has a machine learning model receiving unit 440a, a control unit 440b, and an operating state output unit 440c.

The machine learning model receiving unit (an example of receiving means) 440a can download each machine learning model constructed by the machine learning model construction service 80. Note that each machine learning model is downloaded by secure communication.

The control unit (an example of control means) 440b can control the PLC450 and the imaging unit 460.

The operating state output unit (an example of the operating state output means) 440c can output operation information related to the operating state of the imaging unit 460. This operation information is, for example, information on the time from when the imaging unit 460 starts capturing an image to when it ends. The operation information may be information on the number of images captured by the imaging unit 460.

The terminal 440 functions as a receiving means, a control means, and an operating state output means by a program executed inside the terminal 440.
Further, one terminal 440 is not limited to having all the machine learning model receiving unit 440a, the control unit 440b, and the operating state output unit 440c, and each unit is divided into a plurality of terminals connected to each other. May exist.
Further, the terminal 440 may have a teaching data creating unit 202 instead of the teaching data creating device 20 shown in FIG.

The PLC 450 is a controller managed by a user and controls an inspection device 470 that inspects the inspected object 14 as shown in FIG.

The image pickup unit 460 (see FIG. 9) is managed by the user and can capture an image of the object 14 to be inspected. In addition, the imaging unit 460 can determine the quality of the imaged object 14 to be inspected, based on a plurality of machine learning models.
The image pickup unit 460 is, for example, a camera equipped with a GPU (Graphics Processing Unit). However, the image pickup unit 460 may be a mobile terminal with a camera such as a smartphone.
The imaging unit 460 has a camera unit 460a, a storage unit 460b, and a determination unit 460c.

The camera unit 460a can capture an image of the object to be inspected 14 and acquire image data.
The storage unit 460b can store a plurality of machine learning models downloaded by the machine learning model receiving unit 440a.
The determination unit 460c determines the presence or absence of defects in the inspected object 14, that is, the quality of the inspected object 14, based on the image data of the inspected object 14 captured by the camera unit 460a and the machine learning model stored in the storage unit 460b. Can be determined. The determination unit 460c can perform arithmetic processing by the machine learning model at high speed, and is composed of, for example, a GPU.

Next, the operation of the quality determination system 10a (the method for determining the quality of the object to be inspected 14) will be described with reference to FIG. The pass / fail determination system 10a operates according to the following steps S1 to S9. Of steps S1 to S9, steps S1 to S7 are operations as preparatory steps necessary for performing an actual pass / fail judgment, and subsequent steps S8 and S9 are actual operations in the inspection process before shipment of parts and the like. This is a pass / fail judgment operation.
If possible, the steps S1 to S7 may be performed in a different order, or may be performed in parallel.

(Step S1)
The teaching data creating unit 202 (see FIG. 2) of the teaching data creating device 20 (see FIG. 1) becomes the teaching data group TD shown in FIG. 4 based on the image data of the object 14 to be inspected captured by the imaging unit 460. Create a plurality of image data of the object to be inspected 14.
The teaching data group TD is a plurality of image data of the inspected object 14 including the specified defect and a plurality of image data groups of the inspected object 14 not including the specified defect. Examples of the types of defects include scratches, voids, stains, and foreign matter contamination. However, the defects to be inspected differ depending on the object 14 to be inspected.
The created images of the plurality of objects to be inspected 14 are stored in a storage means (not shown) and transmitted to the server 30 shown in FIG.
The teaching data group TD may be manually created based on the image data of the object to be inspected 14 prepared in advance, instead of being created by the teaching data creating unit 202.

(Step S2)
As shown in FIG. 4, the teaching data group generating unit 302 of the server 30 preprocesses a plurality of images (teaching data group TD) of the object 14 to be inspected generated by the teaching data creating device 20, and according to the feature value. A plurality of classified teaching data groups TD1, TD2, TD3, TD4, ... Are generated. In the pretreatment, for example, a plurality of threshold values TH1 to TH10 (see FIG. 6) for brightness are used.
Each threshold value may be obtained by obtaining the maximum value of the brightness of the defect D and dividing the maximum value.
After that, the server 30 uploads the preprocessed teaching data groups TD1, TD2, TD3, TD4, ... To the machine learning model construction service 80 by the operation of the service provider or the user.
In this way, since the service provider, not the user, performs the preprocessing of the teaching data that requires know-how, the user can easily introduce the pass / fail judgment system 10a based on the machine learning model.

(Step S3)
Machine learning models M1, M2, M3, M4 ... Are constructed by the machine learning model construction service 80 based on the uploaded teaching data group, respectively.
The accuracy of each machine learning model M1, M2, M3, M4 ... Is verified by the optimum model selection unit 306 (see FIG. 3) of the server 30 for each of the constructed machine learning models.
If the accuracy is worse than the predetermined standard, the process returns to the previous step S2, and the teaching data group generating unit 302 performs preprocessing by further applying filter processing or the like.

(Step S4)
By the operation of the user, the machine learning model receiving unit 440a (see FIG. 9) of the terminal 440 downloads each trained machine learning model constructed by the machine learning model construction service 80. Each of the downloaded machine learning models that has been learned is transmitted to the imaging unit 460 via the terminal 440.

(Step S5)
The storage unit 460b of the imaging unit 460 stores each machine learning model downloaded by the machine learning model receiving unit 440a.

(Step S6)
The control unit 440b of the terminal 440 controls the PLC 450 and the imaging unit 460, and the quality of the inspected object 14 manufactured by the inspection device 470 (see FIG. 1) is judged on a trial basis.
Specifically, as a preparatory step for determining the quality of the object 14 to be inspected, the camera unit 460a (see FIG. 9) of the imaging unit 460 captures an image of the object 14 to be inspected, and the determination unit 460c captures the image. Based on the image and a plurality of machine learning models stored in the storage unit 460b, it is inspected whether or not there is a defect in each of the objects to be inspected 14, and if there is no defect, it is determined as a non-defective product and there is a defect. In that case, it is judged as a defective product.

(Step S7)
Each test determination result in the previous step S6 is transmitted from the imaging unit 60 to the server 30 via the terminal 440.
The optimum model selection unit 306 of the server 30 shown in FIG. 3 evaluates the quality of each machine learning model based on each test determination result, and the optimum machine learning model (hereinafter referred to as “optimal model”). Select.
The information of the selected optimum model is transmitted from the server 30 to the terminal 440.

As described above, up to this step S7 is an operation as a preparatory step necessary for actually performing the pass / fail judgment.
The next step S8 and subsequent steps are the actual pass / fail judgment operations in the inspection process before shipping the parts and the like.

(Step S8)
The control unit 440b (see FIG. 9) of the terminal 440 controls the PLC 450 and the imaging unit 460, and the imaging unit 60 is conveyed on the conveyor of the inspection device 470 (see FIG. 1) based on the selected optimum model. The quality of the incoming object 14 to be inspected is determined.
Specifically, the camera unit 460a (see FIG. 9) of the imaging unit 460 captures an image of the object 14 to be inspected, and the determination unit 460c is based on the captured image and the optimum model stored in the storage unit 460b. , It is inspected whether or not the inspected object 14 has a defect, and if there is no defect, it is determined as a non-defective product, and if there is a defect, it is determined as a defective product.

(Step S9)
The operating state output unit 440c (see FIG. 9) of the terminal 440 transmits the operating information regarding the operating state of the imaging unit 460 to the server 30. The transmitted operation information is stored in a storage unit (not shown) of the server 30, and the operation state of the pass / fail determination system 10a is centrally managed by the server 30.

As described above, the quality determination system 10a according to the present embodiment determines the quality of the object to be inspected 14 by using the optimum machine learning model selected from the plurality of constructed machine learning models. A highly accurate judgment result can be obtained.
The quality determination system 10a can determine the quality of the condition other than the appearance of the object 14 to be inspected, depending on the type of the camera unit 460a. For example, when the camera unit 460a is an infrared camera, it is possible to determine whether the internal state of the object 14 to be inspected is good or bad.

[Second Embodiment]
Subsequently, the quality determination system 10b according to the second embodiment of the present invention will be described. The components having the same functions as the quality determination system 10a according to the first embodiment may be designated by the same reference numerals and detailed description thereof may be omitted.
As shown in FIG. 11, the quality determination system 10b includes a teaching data creation device 20, a server 30, and an inspection system 40b.
The inspection system 40b includes a terminal 442, a PLC (Programmable Logic Controller) 450, and an imaging unit 462 that images the object 14 to be inspected.

The terminal 442 (an example of a determination device) is, for example, a personal computer, a smartphone, an MR device for realizing MR (Mixed Reality), or an AR device for realizing AR (Augmented Reality).
As shown in FIG. 12, the terminal 442 includes a machine learning model receiving unit (an example of receiving means) 440a, a control unit (an example of a controlling means) 440b, an operating state output unit (an example of an operating state output means) 440c, and a storage unit. It has (an example of storage means) 460b and a determination unit (an example of a determination means) 460c, and can determine the quality of an object to be inspected based on a plurality of machine learning models.
The terminal 442 functions as a receiving means, a control means, an operating state output means, a storage means, and a determination means by a program executed inside the terminal 442.

The imaging unit 462 has a camera unit 460a.

That is, in the quality determination system 10b, the terminal 442 has the storage unit 460b and the determination unit 460c that the imaging unit 460 according to the first embodiment has.
Even if the terminal 442 has a part of the machine learning model receiving unit 440a, the control unit 440b, the operating state output unit 440c, the storage unit 460b, and the determination unit 460c, and the PLC 450 has the other parts. good. That is, the inspection system 40b may have a machine learning model receiving unit 440a, a control unit 440b, an operating state output unit 440c, a storage unit 460b, and a determination unit 460c as a whole.
Furthermore, the inspection system 40b may not have the machine learning model receiving unit 440a, the storage unit 460b, and the determination unit 460c, but the server 30 shown in FIG.

Comparing the quality determination system 10b according to the present embodiment and the quality determination system 10a according to the first embodiment, as shown in FIGS. 9 and 12, a storage unit provided in the imaging unit 460 is provided. The only difference is that the 460b and the determination unit 460c are provided in the terminal 442.
Therefore, the operation of the pass / fail determination system 10b is substantially the same as the operation of the pass / fail determination system 10a (steps S1 to S9), and the description thereof will be omitted.

[Third Embodiment]
Subsequently, the predictive maintenance system (an example of the quality determination system) 10c according to the third embodiment of the present invention will be described. The components having the same functions as the quality determination system 10b according to the second embodiment may be designated by the same reference numerals and detailed description thereof may be omitted.

The predictive maintenance system 10c according to the present embodiment can determine the quality of the operating state of the monitored object by measuring the sound emitted by the monitored object, and can be applied to predictive maintenance for predicting a defect of the monitored object.
The monitoring target is, for example, a mechanical device, specifically a press machine. However, the monitoring target is not limited to the press machine as long as it is a device or device that can predict a defect by sound.

As shown in FIG. 13, the predictive maintenance system includes a sound source visualization device (an example of the visualization device) 500, a teaching data creation device 20, a server 33, and a terminal 443.

The sound source visualization device 500 includes a camera (not shown) that captures the monitored target 600 and a plurality of microphones 502 for identifying the sound source generated from the monitored target 600, and distributes the sound intensity in the actual image around the sound source. Can output a sound source visualization image that visualizes the sound source by superimposing the above in real time. This sound intensity distribution is expressed as heat map-like visualized information by different colors according to the magnitude of sound pressure.
The sound source visualization device 500 may be called an acoustic camera.

As shown in FIG. 2, the teaching data creating device 20 has a teaching data creating unit 202, and can capture a sound source visualization image and create an image as teaching data.

The server 33 is managed by the service provider, and has a teaching data group generation unit 302, a determination unit 334, an optimum model selection unit 306, and a management unit 308, as shown in FIG.
As shown in FIG. 4, the teaching data group generation unit (an example of the teaching data group generation means) 302 preprocesses the teaching data group TD created by the teaching data creating device 20, and sets the preprocessed teaching data groups. TDg, that is, teaching data groups TD1, TD2, TD3, TD4, ... Are created.

The determination unit (an example of the determination means) 334 virtually determines the quality of the operating state of the monitored target 600 based on the plurality of learned machine learning models constructed by the teaching data group TD and the machine learning model construction service 80. Can be judged.

The optimum model selection unit (an example of the optimum model selection means) 306 can evaluate the determination result by the determination unit 334 and select the optimum machine learning model.

The management unit (an example of the management means) 308 can manage the state of the terminal 443 or the sound source visualization device 500. Specifically, the management unit 308 can record operation information regarding the operation state of the terminal 443 or the sound source visualization device 500.
The server 33 functions as a teaching data group generation means, a determination means, an optimum model selection means, and a management means by a program executed inside the server 33.

The terminal (an example of the determination device) 443 is connected to the sound source visualization device 500 as shown in FIG. The terminal 443 has a machine learning model receiving unit 440a, a control unit 443b, an operating state output unit 443c, a storage unit 443d, and a determination unit 443e, and can determine the quality of the monitored target 600 based on the optimum model.

The machine learning model receiving unit (an example of receiving means) 440a can receive the optimum model selected by the optimum model selection unit 306 from the server 33. The optimum model is received by secure communication.

The control unit (an example of control means) 443b can control the PLC 450 and the sound source visualization device 500.

The operating state output unit (an example of the operating state output means) 443c can output operation information related to the operating state of the terminal 443 or the sound source visualization device 500. This operation information is, for example, information on the time from when the sound source visualization device 500 starts capturing an image to when it ends. The operation information may be information on the number of images output from the sound source visualization device 500.

The storage unit (an example of storage means) 443d can store the optimum model received by the machine learning model reception unit 400a.

The determination unit (an example of the determination means) 443e can determine the quality of the operating state of the monitored target 600 based on the plurality of sound source visualization images output by the sound source visualization device 500 and the optimum model stored in the storage unit 443d.
The terminal 443 functions as a receiving means, a control means, an operating state output means, a storage means, and a determination means by a program executed inside the terminal 443.

Next, the operation of the predictive maintenance system 10c (method for determining the quality of the operating state of the monitored object 600) will be described with reference to FIG. The predictive maintenance system 10c operates according to the following steps S3-1 to S3-9. Of steps S3-1 to S3-9, steps S3-1 to S3-7 are operations as a preparatory stage, and subsequent steps S3-8 and S3-9 are actual operating states of the monitored target 600. This is a pass / fail judgment operation.
If possible, each step S3-1 to S3-7 may be carried out in a different order, or may be carried out in parallel.

(Step S3-1)
The teaching data creation unit 202 (see FIG. 2) of the teaching data creating device 20 (see FIG. 13) takes in the sound source visualization image generated by the sound source visualization device 500 and uses it as teaching data to create the teaching data group TD shown in FIG. do.
The plurality of sound source visualization images (teaching data group TD) are stored in a storage means (not shown) and transmitted to the server 33 shown in FIG.
The teaching data group TD may be manually created based on the sound source visualization image of the monitored target 600 prepared in advance, instead of being created by the teaching data creation unit 202.

(Step S3-2)
As shown in FIG. 4, the teaching data group generation unit 302 of the server 33 preprocesses the sound source visualization image (teaching data group TD) generated by the teaching data creation device 20, and classifies the plurality of sound source visualization images (teaching data group TD) according to the feature values. Teaching data groups TD1, TD2, TD3, TD4, ... Are generated. In the pretreatment, for example, a plurality of threshold values TH1 to TH10 (see FIG. 6) for brightness are used.
Each threshold value may be obtained by obtaining the maximum value of the brightness of the defect D and dividing the maximum value.
After that, the server 33 uploads the preprocessed teaching data groups TD1, TD2, TD3, TD4, ... To the machine learning model construction service 80 by the operation of the service provider or the user.
In this way, since the service provider, not the user, performs the preprocessing of the teaching data that requires know-how, the user can easily introduce the predictive maintenance system based on the machine learning model.

(Step S3-3)
Machine learning models M1, M2, M3, M4 ... Are constructed by the machine learning model construction service 80 based on the uploaded teaching data group, respectively.
The accuracy of each of the constructed machine learning models is verified by the optimum model selection unit 306 (see FIG. 14) of the server 33.
If the accuracy is poor, the process returns to the previous step S3-2, and the teaching data group generating unit 302 preprocesses the sound source visualization image (teaching data group TD) by a different method by applying different filter processing or the like. ..

(Step S3-4)
By the operation of the user, the server 33 (see FIG. 14) downloads each trained machine learning model constructed by the machine learning model construction service 80. Each downloaded machine learning model is stored in a storage unit (not shown).

(Step S3-5)
The determination unit 334 of the server 33 inputs the teaching data group TD into each machine learning model stored in the storage unit (not shown), and virtually determines the quality of the operating state of the monitored target 600.

(Step S3-6)
The optimum model selection unit 306 evaluates the judgment result of the quality of the operating state of the monitored target 600 by the determination unit 334 in the previous step S3-6, and selects the optimum model from the plurality of machine learning models.

(Step S3-7)
The optimum model selected by the optimum model selection unit 306 is transmitted from the server 33 to the terminal 442.
The transmitted optimum model is received by the machine learning model receiving unit 440a (see FIG. 15) and stored in the storage unit 443d.

(Step S3-8)
This step S3-8 is a step of monitoring the monitored target 600.
The control unit 443b of the terminal 443 controls the PLC 450 and operates the monitored target 600. On the other hand, the sound source visualization device 500 measures the sound generated from the monitored object 600 and outputs the sound source visualization image at a predetermined cycle.
The terminal 442 determines the quality of the operating state of the monitored target 600 based on the output sound source visualization image and the optimum model stored in the storage unit 443e.

(Step S3-9)
The operation state output unit 443c of the terminal 440 transmits the operation information regarding the operation state of the sound source visualization device 500 to the server 33. The transmitted operation information is stored in a storage unit (not shown) of the server 33, and the operation state of the predictive maintenance system 10c is centrally managed by the server 33.

As described above, according to the predictive maintenance system 10c according to the present embodiment, the quality of the operating state of the monitored target 600 is determined by using the optimum machine learning model selected from the plurality of constructed machine learning models. Since the judgment is made, predictive maintenance can be performed with higher accuracy.
In addition, instead of the sound source visualization system, it has a detector for measuring a physical quantity that changes due to a sign that a defect of the monitored target 600 occurs, and can generate a plurality of visualized images that visualize the physical quantity. Visualization device may be used.

[Fourth Embodiment]
Subsequently, the predictive maintenance system (an example of the quality determination system) 10d according to the fourth embodiment of the present invention will be described. Components having the same functions as the predictive maintenance system 10c (see FIG. 13) according to the third embodiment may be designated by the same reference numerals and detailed description thereof may be omitted.

The predictive maintenance system according to the present embodiment can determine the quality of the operating state of the monitored object by measuring the vibration generated by the monitored object, and can be applied to predictive maintenance for predicting a defect of the monitored object.
The monitoring target is, for example, a mechanical device, specifically, a press machine or a transfer device. However, the monitoring target may be any device or device that can predict a malfunction due to vibration.

As shown in FIG. 17, the predictive maintenance system 10d includes a vibration visualization device (an example of a visualization device) 700, a teaching data creation device 20, a server 33, and a terminal 443 (an example of a determination device).
The vibration visualization device 700 has a plurality of vibration sensors 702 for detecting the vibration generated from the monitored object 600, and can output a plurality of vibration visualization images that visualize the vibration detected by each vibration sensor 702. This vibration visualization image is, for example, an image represented as information visualized by different colors depending on at least one of the magnitude and frequency of vibration.

Here, in the predictive maintenance system 10d, the vibration visualization device 700 and the vibration visualization image correspond to the sound source visualization device 500 and the sound source visualization image in the third embodiment, respectively.

By using the predictive maintenance system 10d and performing the above-mentioned operation steps S3-1 to S3-9 (see FIG. 16), the determination unit 443e (see FIG. 15) included in the terminal 443 is monitored. If a problem occurs in 600, it can be determined that it is abnormal.

As described above, according to the predictive maintenance system 10d according to the present embodiment, the quality of the monitored target 600 is determined by using the optimum machine learning model selected from the plurality of constructed machine learning models. , Predictive maintenance is possible with higher accuracy.
In addition, instead of the vibration visualization system, it has a detector for measuring a physical quantity that changes due to a sign that a defect of the monitored target 600 occurs, and can generate a plurality of visualized images that visualize the physical quantity. Visualization device may be used.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and all changes in conditions that do not deviate from the gist are within the scope of the present invention.

10a, 10b Good / bad judgment system 10c, 10d Predictive maintenance system 14 Inspected object 20 Teaching data creation device 30 Server 40a, 40b Inspection system 450 PLC
80 Machine learning model construction service 202 Teaching data creation unit 302 Teaching data group generation unit 306 Optimal model selection unit 308 Management unit 334 Judgment unit 440 Terminal 440a Machine learning model reception unit 440b Control unit 440c Operation status output unit 442, 443 Terminal 443b Control Unit 443c Operating status Output unit 443d Storage unit 443e Judgment unit 460 Imaging unit 460a Camera unit 460b Storage unit 460c Judgment unit 462 Imaging unit 470 Inspection device 500 Sound source visualization device 502 Microphone 600 Monitored target 700 Vibration visualization device 702 Vibration sensor N Internet

Claims (15)

1. An instruction data group generating unit that classifies an image containing a defect of a plurality of objects to be inspected according to the brightness that characterizes the defect and generates a plurality of classified instruction data groups.
   A storage unit that stores a plurality of the machine learning models constructed by the machine learning model construction service provided as a cloud computing service and constructs a machine learning model based on the plurality of teaching data groups.
   A camera unit that captures an image of the object to be inspected,
   Based on the plurality of machine learning models stored in the storage unit, a determination unit for determining the quality of the object to be inspected, which is imaged by the camera unit, and a determination unit.
   A quality determination system including an optimum model selection unit that evaluates the result of determination by the determination unit and selects the optimum machine learning model from the plurality of machine learning models.
2. An instruction data group generation unit that classifies an image containing a defect of a plurality of objects to be inspected according to the parameters that characterize the defect and generates a plurality of classified instruction data groups.
   A storage unit that stores a plurality of the machine learning models constructed based on the plurality of teaching data groups, and a storage unit.
   A camera unit that captures an image of the object to be inspected,
   Based on the plurality of machine learning models stored in the storage unit, a determination unit for determining the quality of the object to be inspected, which is imaged by the camera unit, and a determination unit.
   A quality determination system including an optimum model selection unit that evaluates the result of determination by the determination unit and selects the optimum machine learning model from the plurality of machine learning models.
3. In the quality determination system according to claim 1,
   The teaching data group generator has each of the above images.
   Processing P1 for obtaining a feature value representing the brightness that characterizes the defect, and
   A pass / fail determination system that classifies the plurality of images according to the feature values, and performs a process P2 for generating the classified plurality of teaching data groups.
4. In the quality determination system according to claim 1,
   The teaching data group generator has each of the above images.
   From the plurality of reference values that serve as the reference for determining the brightness that characterizes the defect, the process P1 for obtaining a plurality of reference values that represent the brightness that characterizes the defect as feature values, respectively.
   The process P2 of preparing the same number of images as the number of the feature values, classifying the images according to the plurality of different feature values, and generating the classified plurality of teaching data groups is performed. Pass / fail judgment system.
5. A pass / fail judgment method using the pass / fail judgment system according to claim 1.
   A step in which the teaching data group generation unit generates the plurality of teaching data groups,
   A step in which the storage unit stores the plurality of machine learning models,
   A step in which the determination unit determines the quality of the object to be inspected based on the plurality of machine learning models, respectively.
   A step in which the optimum model selection unit selects an optimum machine learning model from the plurality of machine learning models,
   A quality determination method including a step in which the determination unit determines the quality of the object to be inspected using the machine learning model selected by the optimum model selection unit.
6. A plurality of machine learning models for determining the quality of the test object based on a plurality of teaching data groups in which an image containing a defect of the test object is classified according to the brightness that characterizes the defect. A server connected via a network to a cloud computing service for constructing a cloud computing service and a determination device for determining the quality of the object to be inspected based on the plurality of machine learning models.
   The teaching data group generation unit that generates the plurality of teaching data groups, and
   A server including an optimum model selection unit that evaluates the result of the quality determined by the determination device and selects the optimum machine learning model from the plurality of machine learning models.
7. A plurality of machine learning models for determining the quality of the object to be inspected, based on a plurality of teaching data groups in which an image containing a defect of the object to be inspected is classified according to the brightness that characterizes the defect. A computer connected via a network to a cloud computing service for constructing a cloud computing service and a determination device for determining the quality of the object to be inspected based on the plurality of machine learning models.
   Teaching data group generating means for generating the plurality of teaching data groups,
   A program that evaluates the result of the quality determined by the determination device and functions as an optimum model selection means for selecting the optimum machine learning model from the plurality of machine learning models.
8. A server having a teaching data group generation unit and a teaching data group generating unit for generating a plurality of teaching data groups in which an image containing a defect of a plurality of objects to be inspected is classified according to the brightness that characterizes the defect, and the plurality of teaching data groups. Based on this, a computer connected to a cloud computing service that builds a plurality of machine learning models for determining the quality of the object to be inspected and an imaging unit that captures an image of the object to be inspected.
   A storage means for storing the plurality of machine learning models constructed by the cloud computing service.
   A program that functions as a determination means for determining the quality of an object to be inspected, which is imaged by the imaging unit, based on the plurality of machine learning models stored in the storage unit.
9. A visualization device that has a detector for measuring a physical quantity that changes due to a sign that a defect of the monitored object occurs and generates a plurality of visualization images that visualize the physical quantity.
   A teaching data group generating unit that classifies the visualized image including a plurality of previously acquired defects according to the parameters that characterize the defects and generates a plurality of classified teaching data groups.
   A storage unit that stores a plurality of the machine learning models constructed based on the plurality of teaching data groups, and a storage unit.
   An optimum model selection unit that selects the optimum model that is the optimum machine learning model from the plurality of machine learning models, and
   A quality determination unit including a plurality of visualization images generated by the visualization device and a determination unit for determining the quality of the operating state of the monitored object based on the optimum model selected by the optimum model selection unit. Judgment system.
10. A sound source visualization device that has a microphone for identifying a sound source generated from a monitored target and generates a plurality of sound source visualization images that visualize the sound source.
    A teaching data group generation unit that classifies the sound source visualization image including a plurality of previously acquired defects according to the parameters that characterize the defects and generates a plurality of classified teaching data groups.
    A storage unit that stores a plurality of the machine learning models constructed based on the plurality of teaching data groups, and a storage unit.
    An optimum model selection unit that selects the optimum model that is the optimum machine learning model from the plurality of machine learning models, and
    Based on the plurality of sound source visualization images generated by the sound source visualization device and the optimum model selected by the optimum model selection unit, each includes a determination unit for determining the quality of the operating state of the monitored object. Good / bad judgment system.
11. A vibration visualization device that has a vibration sensor for detecting vibration generated from a monitored object and generates a plurality of vibration visualization images that visualize the vibration.
    A teaching data group generating unit that classifies the vibration visualization image including a plurality of previously acquired defects according to the parameters that characterize the defects and generates a plurality of classified teaching data groups.
    A storage unit that stores a plurality of the machine learning models constructed based on the plurality of teaching data groups, and a storage unit.
    An optimum model selection unit that selects the optimum model that is the optimum machine learning model from the plurality of machine learning models, and
    Based on the plurality of vibration visualization images generated by the vibration visualization device and the optimum model selected by the optimum model selection unit, each includes a determination unit for determining the quality of the operating state of the monitored object. Good / bad judgment system.
12. A pass / fail judgment method using the pass / fail judgment system according to claim 9.
    A step in which the visualization device generates the visualization image,
    A step in which the teaching data group generator creates the plurality of teaching data groups,
    A step in which the storage unit stores the plurality of machine learning models,
    A step in which the optimum model selection unit selects an optimum machine learning model from the plurality of machine learning models,
    A quality determination method including a step in which the determination unit determines the quality of the operating state of the monitored object using the machine learning model selected by the optimum model selection unit.
13. A plurality of visualized images that visualize physical quantities that have changed due to a sign that a defect of the monitored target will occur are classified according to the parameters that characterize the defect, and each of the monitored targets is based on a plurality of teaching data groups. A network is provided in a cloud computing service for constructing a plurality of machine learning models for determining the quality of the operating state of the computer, and a determination device for determining the quality of the monitored object based on the plurality of machine learning models. A server connected via
    The teaching data group generation unit that generates the plurality of teaching data groups, and
    A server including an optimum model selection unit for selecting an optimum machine learning model from the plurality of machine learning models.
14. A plurality of visualized images that visualize physical quantities that have changed due to a sign that a defect of the monitored target will occur are classified according to the parameters that characterize the defect, and each of the monitored targets is based on a plurality of teaching data groups. A network is provided in a cloud computing service for constructing a plurality of machine learning models for determining the quality of the operating state of the computer, and a determination device for determining the quality of the monitored object based on the plurality of machine learning models. Computers connected via,
    Teaching data group generating means for generating the plurality of teaching data groups,
    A program that evaluates the result of the quality determined by the determination device and functions as an optimum model selection means for selecting the optimum machine learning model from the plurality of machine learning models.
15. A plurality of visualized images that visualize the physical quantity changed due to a sign that a defect of the monitored object occurs are classified according to the parameters that characterize the defect, and each of the monitored objects is based on a plurality of teaching data groups. A computer connected to a cloud computing service that builds a plurality of machine learning models for determining the quality of the operating state of the device and an imaging unit that captures an image of the object to be inspected.
    A storage means for storing the plurality of machine learning models constructed by the cloud computing service.
    A program that functions as a determination means for determining the quality of an object to be inspected, which is imaged by the imaging unit, based on the plurality of machine learning models stored in the storage unit.
    

Images