JP2018151969A - Database device, learning result management method, and program for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology for identifying and appropriately managing results of learning carried out by machine learning.SOLUTION: A database device comprises: a storage part that stores a plurality of learning results, wherein the learning results are obtained by predetermined learning being carried out by machine learning, and each of the learning results is provided with identification information with which the learning result and learning that has brought about the learning result can be identified in a specific identification range; a receiving part that receives a search condition from a user; a searching part that searches for a learning result associated with the identification information corresponding to the search condition received by the receiving part; and an output part that outputs a result of searching.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a database device, a learning result management method, and a program thereof.

  Conventionally, research on artificial intelligence technology such as a neural network (hereinafter referred to as “AI technology”) has been widely performed (see, for example, Patent Document 1). In particular, with the rise of AI technology called Deep Learning, recognition technology for objects using images, for example, has rapidly improved the recognition rate in recent years, and the level of image classification exceeds human recognition rate. Is reaching. Deep learning technology is not only image recognition, but also voice recognition, personal authentication, behavior prediction, sentence summarization, automatic translation, monitoring, automatic driving, failure prediction, sensor data analysis, music genre determination, content generation, Applications in security systems and other broad fields are expected.

Japanese Patent No. 5816771

  In machine learning such as deep learning, it is possible to acquire a predetermined ability by learning a machine. The ability acquired as a result of learning can be used on another device via a storage medium or communication means, for example, by converting it into information on the structure and parameters of a learned neural network. .

  In a general-purpose learning device or a system that provides a learning service, many learning results are output. Even if the learning device is for a specific purpose, if there are many learning data sets, many learning results are output in the same manner. Since the difference in the learning result affects the result when the learning result is used, the user of the learning result needs to grasp the difference in the learning result. However, as AI technology becomes more widespread in the future, when various types of machine learning are performed in various places, it will become increasingly difficult to grasp the relationship between each learning result. Is expected.

  Therefore, an object of the present invention is to provide a technique for identifying and appropriately managing a result of learning by machine learning.

  A database device according to an aspect of the present invention is a storage unit that stores a plurality of learning results, and the learning results are obtained by performing predetermined learning by machine learning, and each of the learning results Is provided with identification information that can identify the learning result and the learning that brought about the learning result within a specific identification range, a storage unit, a reception unit that receives a search condition from a user, and a reception unit A search unit that searches for a learning result associated with the identification information corresponding to the accepted search condition; and an output unit that outputs the search result.

  According to the above configuration, the learning result is identified by the identification information. Thereby, when a learning result provider or a learning user uses a learning result, it becomes possible to manage a learning result appropriately so that the learning result to be used can be searched. Further, since the learning result is managed by the identification information, the storage capacity can be reduced and the search speed can be improved.

  Further, the identification information may include at least one of first information that can identify predetermined learning, second information that can identify a learning result, and third information that can identify a result brought about by the learning result. .

  According to this aspect, the learning result provider and the learning user can obtain more detailed information about learning.

  Furthermore, the first information, the second information, and the third information are brought about by learning, a learning result, and the learning result, respectively, within a specific identification range among conditions given when predetermined learning is performed. It may be given based on factors that affect the outcome. According to this aspect, identification information is given to the learning result so that it can be identified within a predetermined identification range. Thereby, since it becomes unnecessary to identify outside the predetermined range, the amount of identification information can be reduced.

  Moreover, it is a data structure of the said identification information used for the database apparatus in any one of said, and memorize | stored in a memory | storage part, Comprising: The 1st information which can identify learning, and several linked | related with 1st information The second information and a plurality of pieces of learning result data identified from each other by the plurality of second information. In the database apparatus, the reception unit receives the second information as a search condition. When the first information associated with the second information is specified and the output unit outputs the search result, and the reception unit receives the first information as a search condition, the first information is associated with the received first condition. The learning result data corresponding to the second information is used as a search result for the processing that is output by the output unit. Since the identification information has such a hierarchical structure, learning-related information is stored in a tree structure, so that the storage capacity can be reduced.

  The identification information providing method according to one aspect of the present invention is a step in which a computer stores a plurality of learning results, and the learning results are obtained by performing predetermined learning by machine learning. Yes, each of the learning results is provided with identification information that can identify the learning result and the learning that brought about the learning result within a specific identification range, and a step of accepting a search condition from the user, The step of searching the learning result associated with the identification information corresponding to the search condition received by the receiving step and the step of outputting the search result are executed.

  A program according to an aspect of the present invention is a means for storing a plurality of learning results in a computer, and the learning results are obtained by performing predetermined learning by machine learning. Each is provided with identification information that can identify the learning result and the learning that brought about the learning result within a specific identification range, and is received by the means, the means for receiving the search condition from the user, and the receiving means. It is made to function as a means for searching the learning result associated with the identification information corresponding to the search condition, and a means for outputting the search result.

  ADVANTAGE OF THE INVENTION According to this invention, the technique for identifying and managing appropriately the result of learning by machine learning can be provided.

It is a figure which shows the outline of the whole system by which provision of the learning service in this embodiment is performed. It is a figure which shows notionally the flow of the learning service in this embodiment. It is a block diagram which shows an example of a structure of a learning data preparation apparatus. It is a block diagram which shows an example of a structure of a learning request apparatus. It is a block diagram which shows an example of a structure of a learning result utilization apparatus. It is a block diagram which shows an example of a structure of a learning result database. It is a figure which shows an example of a basic factor. It is a figure which shows an example of an influence factor. It is a block diagram which shows an example of a structure of a learning request reception apparatus. It is a block diagram which shows an example of a structure of a learning apparatus. It is a block diagram which shows an example of a structure of a learning management apparatus. It is a figure which shows an example of the list | wrist of an identification range. It is a figure which shows an example of the structure of the information regarding the learning managed in a learning result database. It is a flowchart which shows an example of a process of a learning request system. It is a flowchart which shows an example of a process of a learning service provision system. It is a block diagram which shows an example of a structure of a control apparatus.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the same element and the overlapping description is abbreviate | omitted. Further, the following embodiments are exemplifications for explaining the present invention, and are not intended to limit the present invention only to the embodiments. Furthermore, the present invention can be variously modified without departing from the gist thereof.

<1. System overview>
An overview of the system in the present embodiment will be described with reference to FIGS. 1 and 2.
FIG. 1 is a diagram showing an outline of the entire system. This system includes a learning service providing system 1 and a learning request system 2, which are connected to each other via a network N0 such as the Internet. Note that the configuration of the present system is not limited to the illustrated configuration, and for example, the learning service providing system 1 and the learning request system 2 may be integrated.

  As shown in FIG. 1, the learning service providing system 1 includes a learning result database 11, a learning request receiving device 12, one or a plurality of learning devices 13, and a learning management system 14, which are local networks N1. Are connected to each other. The learning request system 2 includes a learning data preparation device 21, a learning request device 22, and one or a plurality of learning result utilization devices 23, which are connected to each other via a local network N2. A learning data input device 24 is connected to each of the learning data preparation device 21 and the learning result utilization device 23.

  In the following description, each device included in the learning service providing system 1 and the learning request system 2 is described as being configured by a computer such as a PC (Personal Computer) or a server device, but is not limited thereto. For example, it may be realized by an arbitrary embedded device using a processor. In addition, functions implemented in each device are not limited to a configuration realized by software. Arbitrary functions included in each device may be realized by hardware. For example, the neural networks 132 and 233 described later may be configured by an electronic circuit such as a custom LSI (Large-Scale Integration) or an FPGA (Field-Programmable Gate Array). Further, a part of each device may be realized by an identification means using a physical key, a biochemical method such as DNA, or an optical method such as a hologram.

  FIG. 2 is a diagram conceptually showing the flow of the learning service by the system shown in FIG. The learning request system 2 accesses the learning service providing system 1 via the network N0 and requests machine learning of the ability to be added to the learning result utilization device 23. Information necessary for machine learning (hereinafter also referred to as “learning request information”) is provided from the learning request device 22 to the learning request reception device 12 of the learning service providing system 1 (S1). The learning request information includes, for example, learning target, information for identifying a device that uses the learning result, learning data, and the like.

  The learning request information is transmitted from the learning request receiving device 12 to the learning device 13 (S2). The learning device 13 performs learning based on the learning request information and acquires a new ability as a learning result. The learning result is converted into packaged data that can be copied (S3; hereinafter, also simply referred to as “learning result”). The learning results converted into data are transmitted from the learning device 13 to the learning result database 11 and managed in a format that can be searched by various users (S4, details will be described later). The various users include a learning program creator, a learning result provider, a user who uses learning results, and other persons who are involved in learning results. Further, the learning result is transmitted to the learning result utilization device 23 of the learning request system 2, and the learning result is utilized in the learning result utilization device 23, so that the ability is exhibited (S5).

<2. Function>
<2-1. Learning request system 2>
Next, functions of the learning request system 2 will be described with reference to FIGS. Note that the learning request system 2 is not limited to the configuration described below, and may be configured by a single device, for example.

  First, the learning data input device 24 acquires information about an object to be input data of the neural network 233 described later of the learning result utilization device 23 and data to be input data of the learning data preparation device 21. For example, the learning data input device 24 may be any input device such as a camera, a sensor, a network terminal, or a self-propelled robot sensor.

  FIG. 3 is a functional block diagram of the learning data preparation device 21 in the present embodiment. The learning data preparation device 21 has a function of preparing data (learning data) necessary for learning by a learning module (for example, a neural network 233 described later). As illustrated in FIG. 3, the learning data preparation device 21 includes an operation unit 211, a learning data acquisition unit 212, a learning data storage unit 213, and a data acquisition control unit 214 as functional units.

  For example, the operation unit 211 receives an operation from a user of the learning request system 2 (hereinafter also referred to as “requester”). The learning data acquisition unit 212 acquires data necessary for creating learning data from the learning data input device 24 and stores it in the learning data storage unit 213. The data acquisition control unit 214 controls the operation unit 211, the learning data acquisition unit 212, and the learning data storage unit 213 to prepare data necessary for learning. The communication unit 216 is connected to the local network of the learning request system 2 and transmits data necessary for learning created by the data acquisition control unit 214 to another device.

  The learning data preparation device 21 may be constructed using the same device as the learning result utilization device 23 described later. In this case, the learning data preparation device 21 can also be constructed as an input device externally connected to the learning result utilization device 23.

  FIG. 4 is a functional block diagram of the learning request apparatus 22 in the present embodiment. The learning request device 22 has a function of transmitting learning request information to the learning service providing system 1. As illustrated in FIG. 4, the learning request device 22 includes a learning request unit 221, a learning request content storage unit 222, a learning data storage unit 223, and a communication unit 224.

  The learning request unit 221 receives a learning request from the client, creates learning request information, and transmits the learning request information to the learning service providing system 1 via the communication unit 224. The learning request information transmitted at this time is stored in the learning request content storage unit 222. The learning data transmitted from the learning data preparation device 21 is stored in the learning data storage unit 223.

  Furthermore, the learning request device 22 may determine whether or not the input learning result is suitable for the purpose of use with reference to identification information (details will be described later) given to the learning result. When the learning result matches the purpose of use, the learning requesting device 22 incorporates the learning result into the learning result using device 23 and uses the learning result. On the other hand, when the learning result does not match the purpose of use, the learning requesting device 22 can notify the learning service providing system 1 of the nonconformity. At this time, the learning requesting device 22 may request learning again under different conditions.

  FIG. 5 is a functional block diagram of the learning result utilization device 23 in the present embodiment. The learning result utilization device 23 has a function of providing a new capability to the user using the learning result. As illustrated in FIG. 5, the learning result utilization device 23 includes a learning result input unit 231, a neural network setting unit 232, a neural network 233, a control unit 234, an input unit 235, and a communication unit 236 as functional units. And a data acquisition unit 237 and an output unit 238.

  The learning result input unit 231 receives input of learning results. At this time, the neural network setting unit 232 performs setting for the neural network 233 according to the purpose of use. Further, the control unit 234 controls the data acquisition unit 237 and the input unit 235 to input data necessary for using the learning result to the neural network 233 and uses the learning result. Note that the result of using the learning result is output from the output unit 238 via the communication unit 236.

<2-2. Learning service provision system 1>
The function of the learning service providing system 1 will be described with reference to FIGS. The learning service providing system 1 can be implemented using a data center or a cloud. In this case, each device of the learning service providing system 1 can be constructed using a PC server or a blade PC. By constructing each device of the learning service providing system 1 with a plurality of PCs, the processing time can be shortened when iterative operations such as deep learning are executed. Note that the learning service providing system 1 may have a configuration constructed by a single PC or a configuration implemented by an embedded device.

  FIG. 6 is a block diagram showing the configuration of the learning result database 11 in the present embodiment. The learning result database 11 stores various information necessary for learning. The learning result database 11 has a function for identifying individual learning results, a function for extracting learning results based on a predetermined search condition, and a function for outputting and presenting detailed information on the extracted learning results. You may have.

  As illustrated in FIG. 6, the learning result database 11 includes a learning data DB 111, a learning request DB 112, a learning result use information DB 113, a version management DB 114, a learning program DB 115, and a factor information DB 116.

  The learning data DB 111 stores learning data used for learning. For example, the learning data DB 111 can store learning data in association with learning requirements, such as learning data targets, learning data breakdown, learning data ranges, learning purposes, and the like.

  The learning request DB 112 stores learning request information and contents of learning performed when the learning request information is received from the learning request device 22. For example, the learning request DB 112 can store learning request information in association with learning request information such as information on the learning client, learning data targets, learning data breakdown, learning data range, learning purpose, and the like.

  The learning result usage information DB 113 stores information on learning result and usage history. For example, the learning result use information DB 113 can store information on the result of classification using the acquired classification ability when the classification ability is acquired as the learning result. Further, the learning result use information DB 113 relates to the use of the learning result in relation to the use of learning such as information about the user of the learning result, the target of the learning data, the breakdown of the learning data, the range of the learning data, the purpose of learning, etc. Information can be stored. Further, the learning result usage information DB 113 preferably includes usage identification information. The use identification information is information that can identify the use and result of the learning result, and includes information related to settings (basic factors and influence factors described later) that affect the ID and capability of the device to be used, for example. Since the acquired ability may change depending on the device used and the environment used, the use history can be recorded in more detail when the learning use history DB 133 includes the use identification information.

  The version management DB 114 stores information related to the variation of ability acquired through learning. For example, the version management DB 114 can store information related to the variation of ability for each learning result. The information stored in the version management DB 114 includes learning result identification information to be described later.

  The learning program DB 115 stores a learning program for performing learning. For example, the learning program DB 115 can store learning programs in association with learning requirements such as learning targets, learning data contents, learning goals, and the like. In addition, it is preferable that a large number of learning programs can be registered in the learning program DB 115. In this case, the learning device 13 to be described later can specify a learning program from the learning program DB 115 and specify the learning program by specifying the learning requirements.

  The factor information DB 116 stores information on factors that affect learning results and abilities obtained as a result of learning. Information stored in the factor information DB 116 is managed hierarchically and has a tree-like configuration. In the present embodiment, the factors are roughly classified into basic factors and influence factors. The basic factor is a factor used to identify the learning result in a higher hierarchy. On the other hand, influencing factors are factors that affect learning results other than basic factors. In the factor information DB 116, identification information is given to each stored factor and can be identified from each other.

  With reference to FIG. 7A and FIG. 7B, an example of the information regarding the factor stored in the factor information DB 116 will be described. In the present embodiment, an example in which identification information is managed by classifying factors into basic factors and influencing factors will be described. However, the factor classification method is not limited to this, and the factors may be classified into three or more. It may be managed as a whole.

  FIG. 7A is a table showing an example of a correspondence relationship between basic factors and ID types assigned to the basic factors. The basic factor is a factor capable of grouping the learning results.

  Since learning is performed to acquire a predetermined ability, it can be identified by the acquired ability. Therefore, IDs are assigned to the types of acquired ability and managed. Further, learning is performed based on the request of the learning client, and different learning is performed for each learning request. Therefore, the learning result can be identified also by the learning requester (requester ID). Further, all learning is performed based on the learning data, and the learning result can be identified by the target of the learning data. Since the target of the learning data can be specified by the acquisition source and the acquisition period of the input data, IDs (input data ID and acquisition period ID) are given to these factors and managed as basic factors.

  Even if the acquired abilities are the same (the acquired abilities IDs are the same), the learning result may change due to the influence of the specification of the device in which the abilities are used or the usage environment. Therefore, the use device ID and the target ID are also given to the device to be used and the target to be used, and are managed as basic factors. The basic factors are not limited to those shown in FIG. 7A, and some of the basic factors shown in FIG. 7A may be selectively used, or other factors may be included as long as the learning results can be grouped. .

  FIG. 7B is a diagram illustrating an example of the interrelationship between influence factors. For example, in the past learning, the influence factor is additionally registered in the factor information DB 116 based on the set parameters, conditions, and the like. As shown in FIG. 7B, it is preferable that the influence factors have a mutual relationship in a tree structure. In addition, although illustration is abbreviate | omitted in FIG. 7B, ID which can identify is provided to each influence factor. Moreover, it is preferable that ID given to each influence factor is provided so that a hierarchical structure can be grasped | ascertained.

  As shown in FIG. 7B, the highest hierarchy of influencing factors includes, as an example, an external interface, learning data, affiliation related information, learning time, learning goal, learning device, learning method, ability test. Yes.

  The external interface is a factor related to the interface between the learning program and the outside, such as the type of input data and the type of output data.

  The learning data is a factor related to data used for learning. In the factor information DB 116, the learning data can be managed in secret by giving the learning data an ID and managing it.

  The affiliation related information is a factor based on information related to affiliation such as a learning program. In addition, when each affiliation related information has a rights relationship, it is preferable to manage in the factor information DB 116 as a factor lower than the affiliation related information.

  The time of learning is a factor based on when learning was performed. The learning goal is a factor based on various goals set for each learning.

  The learning device is a factor based on the device on which learning is performed.When learning is performed on the cloud, the name of the cloud operating company and the network address are used instead of the device model. Can be used as a factor.

  The learning method is a factor based on the method by which learning is performed. Although not shown in FIG. 7B, the configuration of the neural network, which is a lower factor of the learning method, includes, for example, techniques such as SVM and regression model before deep learning, deep belief network, Deep Boltzmann machine, stacked self-encoder, auto encoder, restricted Boltzmann machine (RBM), dropout, sparse coating, regularization, denoising self-encoder, type of activation function, sigmoid function, soft sign, soft plus It is preferable to have specific learning methods such as, Relu, and random number series. In addition, the subordinate factors of the configuration of the neural network include the hyper parameter, the configuration of the input layer, the number of layers, the number of units in the hidden layer, the content of each layer (CNN (Conversional Neural Network), RNN (Recurrent Neural Network) , Elman network, Jordan network, ESN (Echo state network), LSTM (Long short term memory network), BRNN (Bi-directional RNN), etc. Information regarding specific neural network settings is preferably included.

  The ability test is a factor based on the test requirements that the learning results should meet. As the ability test is performed, the learning result is affected to be changed to satisfy the requirement, so the ability test is also managed as one of the influencing factors.

  Note that, in a learning method that uses random numbers, such as deep learning, for example, there may be a slight difference in acquired abilities each time learning is performed. In such a case, it is preferable that the learning start time and the learning end time and the ID of the learning device are used as the influence factors for management with an identification ID.

  In addition, among the influencing factors, there may be cases where a plurality of items can be regarded as equivalent. In that case, the same identification ID may be given by grouping a plurality of types of factors. Further, the influence factors are not limited to the above. Various influencing factors occur depending on the learning target, purpose, and environment.

  Since the learning result database 11 according to the present embodiment has the above-described configuration, it becomes possible to identify and manage different learning results, and thereby, in the learning service providing system 1, the learning result identity can be identified. Can be determined. Each DB included in the learning result database 11 can be used from the learning request reception device 12, the learning device 13, the learning management device 140, and the like via a network such as a local network. Details of the search processing of the learning result database 11 will be described later.

  FIG. 8 is a functional block diagram of the learning request receiving apparatus 12 in the present embodiment. The learning request reception device 12 has a function of receiving learning request information from the learning request device 22 and transmitting the learning request information to the learning device 13. As illustrated in FIG. 8, the learning request reception device 12 includes, for example, a learning request reception unit 121, a learning data storage unit 123, a learning request content storage unit 124, and a communication unit 125.

  The learning request reception unit 121 receives a learning request from the learning request device 22. The learning request reception unit 121 registers learning request information included in the received learning request in the learning request DB 112. At this time, the learning request reception unit 121 transmits a notification that the learning request has been received to the learning management device 140 via the communication unit 125. Further, the learning request receiving device 12 can temporarily store the received learning request in the learning data storage unit 123 or the learning request content storage unit 124.

  FIG. 9 is a functional block diagram of the learning device 13 in the present embodiment. The learning device 13 has a function of performing learning based on the learning request information and acquiring a new ability as a learning result. As illustrated in FIG. 9, the learning device 13 includes a learning control unit 131, a neural network 132, a learning result extraction unit 133, a communication unit 134, and a learning result output unit 135 as functional units. .

  In the learning device 13, the learning control unit 131 can control the neural network 132 and perform learning based on the learning request information. The learning result is extracted by the learning result extraction unit 133 and output by the learning result output unit 135 via the communication unit 134.

  When learning is performed a plurality of times in the learning device 13, a plurality of learning results are obtained. In each learning, if the requirements affecting the learning result such as learning data, learning program, learning time, learning goal, etc. are different, the abilities obtained by a plurality of learning results may not be the same. Although details will be described later, in the learning service providing system 1 according to the present embodiment, when there is a possibility that the abilities obtained from a plurality of learning results may not be the same, different identification information is assigned and managed as variations. be able to.

  In addition, the learning apparatus 13 can also make a learning request by itself. In this case, the learning device 13 can perform autonomous learning.

  FIG. 10 is a schematic diagram showing the configuration of the learning management system 14. As shown in FIG. 10, the learning management system 14 includes a learning management device 140, a learning identification information generation device 15, a learning result identification information generation device 16, and a learning result use environment information generation device 17, and these Are connected to each other via a local network.

  The learning management device 140 manages learning results. In the learning service providing system 1 that provides the learning service, it is desirable to manage all the learning results in the learning service providing system 1 individually. Therefore, in the learning service providing system 1, all learning results are managed by the learning management device 140 so that they can be identified from each other. For example, when learning is performed under a condition in which any of the influence factors is different, each learning result may be different. That is, since the learning results are affected differently by changing the configuration of the influence factors, many variations occur in the learning results. The learning management device 140 identifies variations in order to manage learning results.

  As illustrated in FIG. 10, the learning management device 140 includes a learning information acquisition unit 141, a learning control unit 142, a factor information acquisition unit 143, an identification range setting unit 144, an influence determination unit 145, and a communication unit 147. ,have.

  The learning information acquisition unit 141 acquires learning request information via the communication unit 147.

  The learning control unit 142 selects the learning device 13 and the learning program that perform learning based on the learning request information, and instructs learning. Furthermore, the learning control unit 142 has a function of giving the identification information generated by the identification information generating unit 146 to the learning result that has acquired a predetermined ability by learning. Here, giving the identification information to the learning result is a concept including associating the learning result with the identification information. For example, the identification information is added to the data of the learning result, or the learning result is identified to the storage device. Including associating and storing information. In addition to directly associating the learning result with the identification information, it also includes indirectly associating them. For example, when the learning result is associated with an identifier (for example, a serial number) for identifying the learning result itself, the identifier and identification information are also associated with the learning result. included.

  The factor information acquisition unit 143 acquires a list of factors that may influence the learning result from the factor information DB 116. For example, the factor information acquisition unit 143 can acquire information corresponding to the tree structure of the influence factors shown in FIG. 7B (hereinafter also referred to as “influence factor list”).

  The identification range setting unit 144 sets a range (identification range) in which variations need to be identified. Specifying the identification range is equivalent to grouping the learning results. The variation of the learning result only needs to be identified within a range where identification is necessary. That is, when the identification ranges are different, the learning results may not be mutually distinguishable between the different identification ranges. For example, if the study client is different, there may be no problem even if the variations cannot be identified from each other. Specifically, it is only necessary for a certain learning requester to be able to identify within a range requested by himself / herself, and it is not necessary to uniquely identify variations among others' learning results. For example, the identification range setting unit 144 can set the identification range using a list of identification ranges.

  FIG. 11 is a diagram illustrating an example of a list of identification ranges. As shown in FIG. 11, the identification range is configured in a hierarchical manner, for example, and the lower identification range can be inclusive relation to the upper identification range. Specifically, the set including all the identification ranges is the identification range of the entire top level (hereinafter referred to as “first layer”). In the identification range of the first layer, it is necessary that all learning results can be distinguished from each other. For example, when it is necessary to identify all learning results of the learning service provider, the identification range setting unit 144 sets the identification range of the first layer.

  In the example of FIG. 11, the identification range of the second layer below the first layer is a set defined by the learning client and the application field. When the identification range is set for each learning client (second hierarchy) by the identification range setting unit 144, the identification information generating unit 146 generates identification information that can be identified for each learning client. Further, the identification range of the third layer below the second layer is, for example, a company (in the case of FIG. 11, Company A, Company B, Company C) or a type of application field (in the case of FIG. 11, industrial field, (Commercial field, agricultural field). In this case, when an identification range is set for each company (third layer), identification information that can be identified for each company is generated. For example, when a certain company (Company A) has a plurality of factories and further learning about different factories and different lines for each factory line, the identification range setting unit 144 is configured to An identification range may be set for each factory (fourth layer) or for each line (fifth layer). In this case, the identification range setting unit 144 may set a lower identification range based on an element different from the company A with respect to another company (company B or company C).

  Since the identification range has a hierarchical structure, the identification information corresponding to the upper identification range can be excluded from the identification information corresponding to the lower identification range, thereby reducing the capacity of the identification information.

  Note that the identification range set by the identification range setting unit 144 is not limited to the above example, and can be arbitrarily set. For example, the identification range may be set based on basic factors or influence factors. In this case, the list of identification ranges may have a configuration corresponding to the list of influence factors. For example, it is preferable that the tree structure of the influence factors is inherited by the hierarchical structure of the identification range corresponding thereto. Specifically, if the identification range classified by the influence factor “external interface” in FIG. 7B is the identification range of the third layer, the influence factor “input data” positioned below the external interface is, for example, the fourth It becomes the identification range of the layer. At this time, the identification range setting unit 144 can set the identification range based on which hierarchy of the influence factor included in the learning request information belongs to the tree structure of the influence factor shown in FIG. 7B. Note that the identification range setting unit 144 can also set according to a combination of basic factors included in the learning request information.

  Furthermore, the method by which the identification range setting unit 144 sets the identification range is not limited to a method using a list of identification ranges. For example, a set can be directly handled by using a programming language provided with the set as a class.

  The influence determination unit 145 determines the degree of influence of the influence factor on the learning result based on the list of influence factors acquired by the factor information acquisition unit 143.

  For example, the influence determination unit 145 can determine the degree of influence of a basic factor or an influence factor on a learning result using an influence determination logic created for each identification range. The influence determination logic is a logic for determining the influence of the basic factor and the influence factor on the learning program included in the identification range. The influence determination logic determines whether or not there is an influence on the learning result for each factor when a factor (basic factor or influence factor) that may affect the learning result is given as an input. Specifically, for each learning program, the influence determination logic includes factors (basic factors, influencing factors) that affect the learning results, conditions given to the factors (for example, learning data, learning client ID, learning) And the degree of influence on the learning result according to the target), and the degree of influence is determined based on the correspondence.

  In the influence determination logic, for example, in two specific learnings, a factor that completely matches a learning result may be regarded as having no influence. Further, a factor that is determined to be close to the learning result under a predetermined condition may be regarded as having no influence.

  The influence determination logic is created by, for example, the creator of the learning program. When it is difficult to create impact determination logic that can be applied to the entire learning program included in a certain identification range, it is also possible to divide the identification range and create an impact determination logic for each divided identification range. is there.

  The creator of the influence determination logic is not limited to the creator of the learning logic as long as the details of the learning logic are grasped. In order to create an influence judgment logic, the learning logic is used with a predetermined judgment condition according to the content of the configuration such as whether or not random numbers are used in the learning logic and the type and number of data input. In such a configuration, the learning logic needs to be known in detail, such as the switching conditions and the specified items related to the learning method (configuration of the neural network, termination conditions, etc.). Therefore, the person who knows the details of the learning logic can create the influence determination logic.

On the other hand, the data given as an input to the influence determination logic includes data that cannot be known by the creator of the learning logic. For example, the learning logic creator cannot know the learning data for learning and the influence factors designated by the learning client if the learning client and the learning logic creator are different. The following example is given as an example of the influence factor designated by the learning client.
-The model of the device that uses the learning results, the model of the sensor that is used-The number of classification capabilities to be acquired-Languages targeted by language processing ability

  The influence determination unit 145 extracts the information as described above that cannot be known by the creator of the learning program from the learning request information, and gives such information to the influence determination logic that only the person who knows the configuration of the learning program can know. Give as input. As a result, when learning is performed, the influence of basic factors and influence factors on the learning result can be determined, and variations of the learning result can be managed. Further, in the case of a learning service, there is information that only the learning service providing system 1 can grasp, such as information when a learning request is received, information of a selected learning program, information of selected learning data, and the like. These pieces of information are also preferably input to the influence determination logic by the influence determination unit 145 when learning is performed.

  Furthermore, you may use an influence determination logic for the determination of the influence by learning data. In many cases, the difference in the learning data affects the learning result, but the learning data is specified when learning is performed, and the creator of the learning program may not be able to specify the learning data. Even in such a case, by making it possible to acquire information regarding the content of the used learning data, it is possible to create a logic for determining whether there is an influence or not depending on the learning data. Specifically, when the learning data preparation device 21 prepares learning data, detailed information about learning data can be recorded by acquiring information about learning data to be prepared and recording the identification ID.

  Note that the method of determining the influence of the factor on the learning result in the influence determination unit 145 is not limited to the above example. For example, when a predetermined learning program is used as a learning tool, the influence determination unit 145 may determine whether or not there is an influence based on a change in usage method or setting in the program. For example, the influence determination unit 145 can detect a change in the setting by adding information regarding the changed setting to the learning data. Specifically, when the threshold value of the sensor is changed, the influence determination unit 145 can detect the setting change by adding information about the threshold value after the change in addition to the threshold value before the change. . Furthermore, setting changes can be detected by adding information such as IDs and tags.

  On the other hand, for example, when the learning is performed twice without changing the setting related to learning or the learning data, there is no change in the influence factor other than the fact that the learning is performed twice. However, when the learning program uses a random number internally, the acquired ability may be different from the learning result performed multiple times under the same conditions. In such a case, the influence determination logic determines that the learning number affects the learning result. As a result, the identification information generation unit 146, which will be described later, can provide identification information such as the number of learnings = first time and the number of learning times = 2.

  Furthermore, the method for determining the presence or absence of influence is not limited to the above, and any method can be used. For example, the person in charge of learning data acquisition may operate the keyboard and mouse (operation unit 211) of the learning data preparation device 21 to input information for identification. Moreover, the structure which grasps | ascertains the difference of request content and determines the presence or absence of influence based on the information contained in the learning request information from the learning request apparatus 22 may be sufficient.

Returning to FIG. 10, the continuation of the configuration of the learning management system 14 will be described.
The learning identification information generation device 15 identifies the identification information (hereinafter referred to as “first”) so that learning variations can be identified from each other according to the range in which the learning result is used (for example, the identification range set by the identification range setting unit 144). Information "). For example, the learning identification information generation device 15 gives the first information to the learning based on a factor that affects the learning result. Specifically, the learning identification information generation device 15 selects an influence determination logic based on a learning program corresponding to the learning request information. Next, the learning identification information generation apparatus 15 inputs the identification range and the list of influence factors to the selected influence determination logic. The learning identification information generation device 15 generates data that is the source of the first information so that the influence determination logic includes all the influence factors determined to affect the learning result. Further, the learning identification information generation device 15 generates the first information of learning by converting the data that is the basis of the first information by a predetermined method.

  The process of the learning identification information generation device 15 will be described in more detail. The influence factors have a tree structure as described above (see FIG. 8B). The learning identification information generation apparatus 15 deletes from the tree structure a branch that does not include the influence factor determined as the influence factor that is affected by the influence determination logic. This process is sequentially executed from the upper layer to the lower layer of the tree structure to create a tree (hereinafter also referred to as “influence factor explanation information”). The learning identification information generation device 15 can use the data string obtained by sequentially listing the influence factor IDs included in the influence factor explanation information from the upper layer as the data that is the source of the first information. The data string at this time may be, for example, a character string, a binary format, an XML format, or an expression method such as JSON (Java Script (registered trademark) Object Notification). In the data string obtained by this procedure, it is preferable that the predetermined influence factor includes information on the degree of influence on the learning result. In this case, for example, the influence determination unit 145 describes the degree of influence in the tree structure according to the output of the influence determination logic, and the learning identification information generation device 15 lists the influence degree in the data string as well. Is preferred.

  The learning identification information generation device 15 converts the data string by a predetermined method such as listing, compression, or encryption, and generates first information. The predetermined method is a method in which different first information is generated if the original data string is different at this time.

  As an example, the first information generated at this time is a predetermined character string such as “qijsudi48fuhu” or “nvfsuki3fjn45ip”. This character string may be randomly generated. In this case, the learning identification information generation device 15 can prevent the same first information from being assigned to different learning results by managing the generated character string and the original data string in a list. However, the example of the first information is not limited to the character string, and any method that can reduce the amount of information from the data string can be used.

  The learning identification information generating device 15 can generate the first information by any method other than the above. For example, it is possible to create a program in an object-oriented language, define factor information in a hierarchical class, and serialize the result of marking the class instance and register it in the database.

  For example, in learning methods that use random numbers, such as deep learning, every time learning is performed as described above, there may be a slight difference in acquired abilities. In such a case, the learning identification information generation device 15 adds information (derived identification information) indicating the number of times as in the first learning and the second learning to the first information generated by the above-described method. Also good. Further, when a large number of PCs are used as the learning device 13, the first information can be generated by combining the used PC names (for example, “C2145.33rd learning”).

  The first information can also have a hierarchical structure according to basic factors and influence factors.

  The learning result identification information generating device 16 generates identification information (hereinafter also referred to as “second information”) for identifying a learning result that is a result of learning. The learning results may be different even if the influence factors are the same (that is, even when learning with the same first information is performed). In such a case, even if the influence factors are the same, the results (learning results) using the learning results may be different. Since the user who uses the learning result is interested in the learning result, it is preferable to identify the learning result as another learning result when the learning result may be different even if the influence factor is the same. The learning result identification information generation device 16 identifies the learning result by adding the second information so that the learning result can be identified even in such a case.

  The second information is, for example, information for identifying learning (information indicating what kind of learning has been performed. For example, the first information), information regarding the environment in which learning is performed (where and what apparatus is used for learning) Information about the device that uses the learning result (information indicating where and how it is used), information about the ability acquired by the learning result (what kind of ability was acquired) Information) and the like.

  Such information for identifying the learning result is preferably generated based on the learning request. For example, when learning related to control of robots having different sizes is requested in a learning request, the information for identifying the learning result preferably includes information indicating the size of the robot in which the learning result is used.

  The second information may further include information that can identify the content of the learning result. That is, the second information can include information capable of determining whether or not the learning result matches the content requested by the client. For example, the learning result identification information generation device 16 refers to the learning request DB 112 based on the second information, and includes detailed information (for example, learning) regarding individual influence factors necessary for identifying the contents of the learning result. Data identifiers, learning target values, etc.) can be retrieved and notified to the client together with the first information and the second information. The client can identify the contents of the learning result by referring to the notified detailed information.

The learning result use environment information generation device 17 generates use identification information (third information) that is information related to the result of the learning result and the use state. When the learning result is used in the learning result utilization device 23, it is preferable to manage items such as a copy of the learning result, a transfer of the copy, a use situation of the learning result, and the like in addition to information on the result of the learning result. For this reason, it is preferable that the learning result use environment information generation device 17 stores the following information on results and use conditions in the learning result use information DB 113 in association with the second information.
・ Capabilities acquired through learning ・ Users of learning results ・ Devices that use learning results ・ Places where learning results are used ・ Purposes of learning results ・ Targets of learning results ・ Combination of learning results ・ Division of learning results・ Use history of learning results

  In the learning result use information DB 113, the above information is converted into recordable data and recorded in time series. At this time, it is preferable to generate the usage identification information for identifying the result and the usage status in the same manner as the identification information for learning and the learning result described above.

<3. Data structure>
With reference to FIG. 12, an example of the structure of the information regarding learning stored in learning result utilization information DB113 is demonstrated. In the learning result use information DB 113, information related to learning is stored in a tree structure as shown in FIG. Specifically, a plurality of learning result identifiers (second information) ID2 are associated with a learning identifier (first information) ID1, and each of the plurality of learning result identifiers ID2 includes a result or Usage identification information (third information) related to the usage status is linked. Thus, in the learning result use information DB 113, information related to learning is stored in a tree structure, so that the storage capacity can be reduced.

<4. Search process>
The search function of the learning result database 11 will be described. As users of the learning result database 11, the following persons are assumed as an example.
・ Learning framework creator ・ Learning program creator ・ Learning manager ・ Learning data manager ・ Learning result manager ・ Learning result utilization device 23 developer ・ Learning result utilization device 23 administrator ・ Learning User of result utilization device 23

  The above users may use the learning result database 11 in different usage forms. For example, the creator of the learning framework uses it to associate detailed information during learning with the learning result. The creator of the learning program is used to record details of the learning program. Further, the learning manager uses it to record detailed information for managing learning. Further, the administrator of learning data is used for associating and managing detailed information as to where and how learning data is used. The manager of the learning result is used to manage how the learning result is obtained by using detailed information.

  Further, the developer of the learning result utilization device 23 may incorporate the function of the learning result database 11 into the database function for using the learning result provided in the learning result utilization device 23. In addition, the administrator of the learning result utilization device 23 may grasp and manage the contents of the learning result incorporated in the learning result utilization device 23 in detail. Furthermore, the user of the learning result utilization device 23 determines whether the learning result to be used is obtained as a result of similar learning, whether the learning result is useful, and whether the learning result is useful. There is a case to grasp and use.

  Since the learning result database 11 according to the present embodiment manages information related to learning with a tree structure that can be configured in an arbitrary shape, the learning result database 11 can correspond to the above various usage forms.

  For example, the user can search the learning result database 11 by combining influence factors. In addition, for example, the user can search by arbitrarily combining the first information, the second information, information on the usage environment, and the like. The learning result database 11 can output the search results as a list or a set for such a search. Further, the learning result database 11 may be configured to perform various logical operations such as sum, product, negation, etc. on a list or set of search results and output the result. Further, the learning result database 11 can also output detailed information hierarchically detailed for each matter. The learning result database 11 may be configured to output a summary of search results and statistical data based on the search results. As a result, when the user of the learning result database 11 searches for a learning result for robot control, for example, the user can search for a learning result showing a high result in an environment similar to his factory, You can search what kind of learning you are doing.

<5. Use of identification information>
Next, an example of using the learning result identification information will be described.
By using the identification information of the learning result, the client can mutually identify the acquired ability variations. That is, the learning results can be compared to compare the fitness for the purpose, and an appropriate variation can be selected for each target.

  In addition, by identifying the learning results, the correspondence between the devices using the learning results and the learning results used, the correspondence between the learning results used and the target, and the ability acquired from the learning results Affiliation, affiliation of factors that brought about the learning result with respect to replication of the learning result can be identified and managed. Further, by identifying the learning result, it becomes possible to manage the usage history of the acquired ability, the place where the acquired ability exists, the output of the acquired ability, and the like.

  A specific example of identification information generated by specific use of the present invention and a method of using the same will be described. In the following usage examples, the identification information generation unit 146 does not perform encryption or the like on the above-described data string obtained from the influence factor list using the influence determination logic in order to facilitate understanding. Indicates. Even in this case, by using a different encryption key for each user, it is possible to prevent others from knowing the content of the identification information. Moreover, the examples given below can be arbitrarily combined.

(Usage example A): Example in which one influence factor is different / Usage example A-1: Example in which the target is different When the target is different among the same learning requesters, different learning result identification information is given to each learning result. The For example, identification information such as “target device = SX9100.jdsjhfsd” or “target device = SX9200.djsfhsjfk” is given.
On the other hand, when the target sensor is different in the same target device, identification information such as “target sensor = group a74.jhsjhuo” or “target sensor = group a90.jsdfhjkg” is given (however, the target device Is common to SX9100, and the identification range is an example of SX9100.)

-Usage example A-2: Example when learning multiple times (however, identification of the target device is required)
In this case, “target device = SX9100.1 learning”, “target device = SX9100.2 learning”, “target device = SX9100.learning end time = 201606070723521”, “target device = SX9100.learning”. Identification information such as “end time = 20140708114335” is given.

Usage example A-3: Example in which learning data is different In this case, “target device = SX9100. Learning data = 000001-019999”, “target device = SX9100. Learning data = 020000-029999”, “target device = SX9100” .. Learning data = April 2015 ”and“ Target device = SX9100. Learning data = May 2015 ”are given.

Usage example A-4: Example with different learning programs In this case, identification information such as “learning program = DQ2939. Target device = SX9100” or “learning program = DQ3200. Target device = SX9100” is given.

Usage example A-5: Example in which the requester is different For example, when the request department is different, “target device = SX9100. Request department = first engineering section” or “target apparatus = SX9100. Request department = second engineering section” Such identification information is given.

(Usage example B): An example in which a plurality of influence factors are different. For example, an example in which a client who is a basic factor and an object and learning data are different is “target device = SX9100. Request department = first engineering section. Learning data = 2015”. Identification information such as “April portion” or “Target device = SX9200. Request department = first technical section. Learning data = July 2016” is given.

(Usage example C): An example in which the range in which the identification information is used is different. For example, the identification information in the learning service provider is “Learning requester = Company A. Target device = SX9100. Learning program DQ2939. Learning data = 020000 029999 ”, and the different requesters are distinguished such as“ Learning requester = Company B. Target device = JQR939400. Learning program DQ2939. Learning data = July 2016 ”. In this case, the following identification information can be obtained from the identification information provided to the user by removing the identification information about the learning requester.
Identification information provided to the study client A company: “Target device = SX9100. Learning program DQ2939. Learning data = 02000 to 029999”
Identification information provided to study client B: “Target device = JQR939400. Learning program DQ2939. Learning data = July 2016”

<6. System flow>
Next, a processing flow of the system according to the present embodiment will be described with reference to FIGS. 13 and 14. FIG. 13 is a flowchart showing a processing flow in the learning request system 2.

  First, the client prepares learning data using the learning data preparation device 21 (S101). Next, the requester inputs learning request information using the learning request device 22 (S102). Further, the requester requests learning from the learning request device 22 to the learning service providing system 1 (S103). When learning is performed in the learning service providing system 1, the learning requesting device 22 receives the learning result from the learning service providing system 1 (S104), and stores the received learning result (S105).

  The learning request device 22 selects an appropriate learning result from the stored learning results when using the learning results in the learning result utilization device 23 (S106). At this time, the learning requesting device 22 refers to the identification information of the learning result and determines whether or not the selected learning result is suitable for the purpose of use (S108). If it matches the purpose of use (S108: Yes), the learning result is incorporated into the learning result utilization device 23 (S109), and the learning result is utilized in the learning result utilization device 23 (S110).

  On the other hand, when the learning result selected in S108 does not match the purpose of use (S108: No), a notification of nonconformity is sent (S119), and the learning is performed again while changing the conditions as necessary (S120).

  Next, the processing flow of the learning service providing system 1 will be described. FIG. 14 is a flowchart showing a processing flow in the learning service providing system 1.

  First, the learning request receiving apparatus 12 receives learning request information from the learning request apparatus 22 and receives a learning request (S201). Next, the identification range setting unit 144 in the learning management device 140 acquires information necessary for setting the identification range (S202). The identification range setting unit 144 sets an identification range from the acquired information and learning request information (S203).

  The learning control unit 142 selects the learning device 13 and the learning program based on the learning request information and the set identification range (S204), and notifies the learning device 13 that has selected the learning request information (S205). Is instructed (S206).

  The influence determination unit 145 refers to the factor information DB 116 and extracts a list of influence factors. Further, the influence determination unit 145 acquires the influence determination logic corresponding to the learning program from the learning device 13 (S207), and determines the degree of influence of each factor on the learning result using the acquired influence determination logic (S208). ). The influence determination unit 145 sets a determination result for each influence factor listed in the influence factor list (S209).

  Next, the identification information generating unit 146 removes the influence factor set as having no influence from the influence factor list (S210), and generates the identification information of the learning result using the influence factor list after the removal. Then, the identification information generating unit 146 registers the generated identification information and the learning result in association with each other in the version management DB 114 (S212).

  As described above, according to the learning service providing system 1 according to the present embodiment, it is possible to appropriately manage variations of the ability acquired by the machine.

  The embodiment of the present invention has been described above. Note that this embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention can be changed or improved without departing from the spirit of the present invention. For example, each step in the above-described processing flow can be executed in parallel, with some of the steps omitted in a range where no contradiction occurs in the processing content, or the order of the processing steps is arbitrarily changed.

  In the above-described embodiment, the example in which the ability acquired by the machine is managed by the AI technology such as deep learning using the system according to the present invention has been described. However, the present invention is not limited to this and is applied to a wide range of fields. Can be applied. For example, the present invention can be applied to various industrial fields such as identification of good and defective products, food products, machine parts, chemical products, and pharmaceuticals, fishery fields, agricultural fields, forestry fields, service industries, medical care, and health fields. Further, the present invention may be applied to a case where AI technology is applied to products in the embedded field, a system utilizing IT technology such as a social system, analysis of big data, and a classification function in a wide range of control devices.

  In this specification, “unit” or “means” does not simply mean a physical configuration, but also includes a case where the function of the “unit” is realized by software. Further, even if the function of one “unit” or “means” or device is realized by two or more physical configurations or devices, the function of two or more “units” or “means” or devices is one. You may implement | achieve by a physical means and an apparatus.

Moreover, although a part or all of said embodiment may be described also as the following additional remarks, it is not restricted to the following.
(Appendix 1)
Comprising at least one hardware processor;
The hardware processor is
Store multiple learning results,
Accept search conditions from users,
Search the learning result associated with the identification information corresponding to the accepted search condition,
A database device characterized by outputting a search result,
The learning result is obtained by performing predetermined learning by machine learning, and each learning result is given identification information that can identify the learning result within a specific identification range.
(Appendix 2)
By at least one or more hardware processors,
A step of storing a plurality of learning results, wherein the learning results are obtained by performing predetermined learning by machine learning, and each learning result identifies a learning result within a specific identification range. Possible identification information is given, step,
Receiving a search condition from a user;
An identification information providing method for executing a step of searching for a learning result associated with identification information corresponding to an accepted search condition and a step of outputting the result of the search.

<7. Examples of inspection machines>
An example in which the inspection machine learns a predetermined ability using the learning service providing system 1 according to the present embodiment will be described. For example, the electronic circuit board manufacturer 1 selects a good product and a defective product using an inspection machine. In this example, a case will be described in which the manufacturer 1 is a learning requester, and the inspection machine acquires the ability to select good and defective products by learning.

  First, the manufacturer 1 makes a learning request from the learning request device 22 to the learning request accepting device 12 of the learning service provider A so as to deliver a learning model that operates on the inspection machine a owned by the manufacturer 1. . Specifically, the manufacturer 1 determines a plurality of images of the electronic circuit board captured by the camera provided in the inspection machine a at the time of the learning request, and the manufacturer 1 determines a non-defective product or a defective product for each image. Information including data obtained by combining the results is provided as learning request information to the learning service provider A, and a learning request is made.

At this time, the learning request DB 112 stores, for example, information shown below as information such as the ability to acquire, the learning requester, the target of learning data, and the acquisition period.
・ The ability to acquire is to discriminate between non-defective and defective circuit board mounting, and the correct answer rate based on the learning result is 90% or more. ・ The learning requester is the circuit board manufacturer A. The target of the learning data is the captured image of the circuit board acquired by the inspection machine a of the circuit board manufacturer A, and the result of the manufacturer 1 determining the non-defective product or the defective product for each captured image. The acquisition period is, for example, from June 1, 2016 to June 15, 2016

  Further, in addition to the requested information, the learning service provider A is provided by the manufacturer 1 after adding information such as what algorithm the learning service provider A performs learning such as deep learning. Learning is performed by the own learning device 13 using the image as learning data and the determination result of non-defective product or defective product as teacher data.

  For example, the learning device 13 uses the learning data of the manufacturer 1 as an input, and performs deep learning so that a good product or a defective product can be classified. After the deep learning is completed, for example, the learning service provider A acquires the learning model configuration information such as the number of layers of the neural network 132 in the learning device 13 and the weight of each node, or the learned neural network 132 itself. And delivered to manufacturer 1.

  At this time, the learning service provider A generates the first information using the learning management device 140 and the learning identification information generation device 15. Specifically, the influence determination unit 145 of the learning management device 140 extracts the influence factor by the influence factor determination logic, and the learning identification information generation device 15 generates the first information based on the influence factor. In this case, in addition to the learning request information described above, influential factors are determined including information such as a learning algorithm provided from the learning service provider A side, which can be the first information for identifying learning. Further, for example, when the learning service provider A has a plurality of learning devices 13, learning whether the learning device A has performed learning by the learning device A or the learning device B among the plurality of learning devices 13. The second information that can identify the result may be generated by the learning result identification information generating device 16. Further, as the third information, information for identifying whether the learning result is used by the inspection machine A of the manufacturer A or the inspection machine B is generated by the learning result use environment information generation device 17. Good.

<8. Example of manufacturing apparatus>
Next, an example in which the manufacturing apparatus is made to learn a predetermined ability using the learning service providing system 1 according to the present embodiment will be described. For example, the electronic circuit board manufacturer 1 assembles a product using the manufacturing apparatus b. In this example, a case where the manufacturer 1 is a learning requester and the manufacturing apparatus b acquires the ability to select parts to be assembled in a predetermined process by learning will be described.

  First, the structure of the manufacturing apparatus b is demonstrated using FIG. FIG. 15 is a block diagram illustrating an example of the configuration of the control device b. As illustrated in FIG. 15, the manufacturing apparatus b includes a storage unit B1, an input unit B2, a determination unit B3, and an output unit B4. The storage unit B1 stores a learning result of learning performed by the learning service providing system 1, for example. The input unit B2 has a function of acquiring information on parts of the electronic circuit board to be manufactured, and is configured by, for example, a camera or a microphone. The determination unit B3 has a function of determining a component to be assembled in a predetermined process based on component information (for example, an image) input from the input unit B2. The output unit B4 has a function of outputting the determination result of the determination unit B3. Here, outputting the determination result means not only presenting the determination result to the user, for example, displaying the determination result on a display device or the like, but also the operation of the manufacturing apparatus such as selecting a predetermined part from other parts. Is included.

  First, the manufacturer 1 makes a learning request from the learning requesting device 22 to the learning request accepting device 12 of the learning service provider A to deliver a learning model that operates on the manufacturing device b owned by the manufacturer 1. . Specifically, the manufacturer 1 includes a plurality of images relating to a plurality of parts of the electronic circuit board captured by a camera provided in the manufacturing apparatus b at the time of the learning request, and a process in which the manufacturer 1 exists for each image. Information including data obtained by combining the result determined to be an assembly target part is provided to the learning service provider A as learning request information, and a learning request is made.

At this time, the learning request DB 112 stores, for example, information shown below as information such as the ability to acquire, the learning requester, the target of learning data, and the acquisition period.
・ The ability to be acquired is to identify parts to be assembled in a predetermined process, and the correct answer rate according to the learning result is 90% or more. ・ The learning requester is a circuit board manufacturer A. The target of the learning data is the captured image of the circuit board component acquired by the manufacturing apparatus b of the circuit board manufacturer A, and the component that the manufacturer 1 is to assemble in a certain process for each captured image. The acquisition period is, for example, from June 1, 2016 to June 15, 2016

  Further, in addition to the requested information, the learning service provider A is provided by the manufacturer 1 after adding information such as what algorithm the learning service provider A performs learning such as deep learning. Learning is performed by the own learning device 13 using the image as learning data and the determination result of the selected part as teacher data.

  For example, the learning device 13 receives the learning data of the manufacturer 1 and performs deep learning so that a part to be assembled can be selected in a predetermined process. After the deep learning is completed, for example, the learning service provider A acquires the learning model configuration information such as the number of layers of the neural network 132 in the learning device 13 and the weight of each node, or the learned neural network 132 itself. And delivered to manufacturer 1.

  At this time, the learning service provider A generates the first information using the learning management device 140 and the learning identification information generation device 15. Specifically, the influence determination unit 145 of the learning management device 140 extracts the influence factor by the influence factor determination logic, and the learning identification information generation device 15 generates the first information based on the influence factor. In this case, in addition to the learning request information described above, influential factors are determined including information such as a learning algorithm provided from the learning service provider A side, which can be the first information for identifying learning. Further, for example, when the learning service provider A has a plurality of learning devices 13, learning whether the learning device A has performed learning by the learning device A or the learning device B among the plurality of learning devices 13. The second information that can identify the result may be generated by the learning result identification information generating device 16. Further, as the third information, information for identifying whether the learning result is used by the inspection machine A of the manufacturer A or the inspection machine B is generated by the learning result use environment information generation device 17. Good.

DESCRIPTION OF SYMBOLS 1 Learning service provision system, 2 Learning request system, 11 Learning result database, 12 Learning request reception apparatus, 13 Learning apparatus, 14 Learning management system, 21 Learning data preparation apparatus, 22 Learning request apparatus, 23 Learning result utilization apparatus, 24 Learning Data input device, 121 learning request reception unit, 123 learning data storage unit, 124 learning request content storage unit, 125 communication unit, 131 learning control unit, 132 neural network, 133 learning result extraction unit, 134 communication unit, 135 learning result output , 140 learning management device, 141 learning information acquisition unit, 142 learning control unit, 143 factor information acquisition unit, 144 identification range setting unit, 145 influence determination unit, 146 identification information generation unit, 147 communication unit, 211 operation unit, 212 Learning data acquisition unit, 213 Learning data recording Unit, 214 data acquisition control unit, 216 communication unit, 221 learning request unit, 222 learning request content storage unit, 223 learning data storage unit, 224 communication unit, 231 learning result input unit, 232 neural network setting unit, 233 neural network, 234 control unit, 235 input unit, 236 communication unit, 237 data acquisition unit, 238 output unit

Claims (7)

A storage unit for storing a plurality of learning results, wherein the learning results are obtained by performing predetermined learning by machine learning, and each of the learning results is within the specific identification range. A storage unit to which identification information that can identify the learning result and the learning that brought about the learning result is given;
A reception unit for receiving search conditions from a user;
A search unit for searching for a learning result associated with identification information corresponding to the search condition received by the reception unit;
An output unit for outputting the search result;
A database apparatus comprising: The identification information includes at least one of first information capable of identifying the predetermined learning, second information capable of identifying the learning result, and third information capable of identifying a result brought about by the learning result. ,
The database device according to claim 1. The first information, the second information, and the third information are learning, a learning result, and the learning result, respectively, within the specific identification range among conditions given when the predetermined learning is performed. Granted based on factors that affect the outcomes of
The database apparatus according to claim 2. A data structure of the identification information used in the database device according to claim 2 or 3 and stored in the storage unit,
First information capable of identifying the learning;
A plurality of second information linked to the first information;
A plurality of learning result data identified from each other by a plurality of the second information;
Including
In the database device,
When the reception unit receives the second information as a search condition, the output unit outputs the search result by specifying the first information associated with the received second information,
When the reception unit receives the first information as a search condition, the output unit outputs the learning result data corresponding to the second information associated with the received first condition as a search result. Used for processing,
Data structure of identification information. A learning result management method executed by a computer including a control unit,
The control unit stores a plurality of learning results, and the learning results are obtained by performing predetermined learning by machine learning, and each of the learning results is a specific identification. Identification information that can identify the learning result and the learning that brought about the learning result within a range is provided; and
The control unit accepting a search condition from a user;
The control unit searching for a learning result associated with the identification information corresponding to the search condition accepted by the accepting step;
The control unit outputting the search result;
Learning result management method to execute. Computer
A means for storing a plurality of learning results, wherein the learning results are obtained by performing predetermined learning by machine learning, and each of the learning results is stored in the learning range within a specific identification range. A means to which identification information capable of identifying the result and the learning that has resulted in the learning result is given;
Means for accepting search conditions from users,
Means for searching for a learning result associated with identification information corresponding to the search condition received by the means for receiving; and means for outputting the result of the search;
Program to function as. A manufacturing apparatus that can apply a learning result that is a result of predetermined learning performed to acquire a predetermined ability,
A storage unit for storing the learning result;
An input unit for inputting information about the part;
A discriminator for discriminating a predetermined part based on the information of the part;
An output unit capable of outputting a result determined by the determination unit;
With
The learning result is
In the storage unit, the first information that can identify the predetermined learning from other learning and the second information that can identify the learning result by the predetermined learning from another learning result are stored in association with each other. The
manufacturing device.