Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/08—Learning methods
  • G06N3/084—Backpropagation, e.g. using gradient descent
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/08—Learning methods
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/04—Architecture, e.g. interconnection topology
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/04—Architecture, e.g. interconnection topology
  • G06N3/0464—Convolutional networks [CNN, ConvNet]
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/08—Learning methods
  • G06N3/09—Supervised learning
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N20/00—Machine learning
  • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/02—Neural networks
  • G06N3/04—Architecture, e.g. interconnection topology
  • G06N3/047—Probabilistic or stochastic networks
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N3/00—Computing arrangements based on biological models
  • G06N3/12—Computing arrangements based on biological models using genetic models
  • G06N3/126—Evolutionary algorithms, e.g. genetic algorithms or genetic programming
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
  • G06N5/00—Computing arrangements using knowledge-based models
  • G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound

Definitions

• the present invention relates to the training of Artificial Intelligence models.
• the invention provides for a method of training an artificial intelligence model.
• the artificial intelligence model has adjustable parameters.
• the adjustable parameters affect the performance and operation of the artificial intelligence model.
• the artificial intelligence model may therefore be trained by modifying or adjusting the adjustable parameters.
• the artificial intelligence model is trained to provide an analysis result in response to receiving an input data set.
• the input data set comprises one or more chosen variables.
• the method comprises receiving a training data set for training the artificial intelligence model.
• the training data set comprises multiple groups of training input data paired with a training analysis result.
• the training input data may be data which is used as a trial basis as input into the artificial intelligence model.
• the output of the artificial intelligence model may then be compared with the training analysis result.
• the method further comprises receiving a trial analysis result from the artificial intelligence model in response to inputting the multiple groups of training input data as input data into the artificial intelligence model.
• the training input data is input into the artificial intelligence model and in response atrial analysis result is received.
• the method further comprises calculating an accuracy metric descriptive of a comparison between said trial analysis result and said training analysis result.
• the trial analysis result which is the result that comes out of the artificial intelligence model, is compared to the training analysis result and the accuracy metric provides a measure or value which evaluates how close or accurate the trial analysis result is to the training analysis result.
• the method further comprises calculating a fairness score metric by comparing the one or more chosen variables to the trial analysis result.
• a fairness measure or fairness score in artificial intelligence refers to a measure how much a particular variable or in this case the one or more chosen variables affect the output of the artificial intelligence model.
• the method further comprises calculating a combined metric from the fairness score metric and the accuracy metric.
• the method further comprises modifying the adjustable parameters of the artificial intelligence model using a training algorithm that receives at least said combined metric as input.
• the invention provides for a computer system that comprises a processor and a memory storing machine-executable instructions.
• the execution of the machine-executable instructions causes the processor to implement a method according to an embodiment.
• invention provides for a computer program product comprising a computer-readable storage medium having a computer-readable program code embodied therewith.
• the computer-readable program code is configured to implement a method according to an embodiment.
• the invention provides for a computer program product.
• the computer program product comprises a computer-readable storage medium having stored on it an artificial intelligence model trained according to an embodiment of the method.
• the invention provides for a memory storing data for access by an application program being executed on a data processing system.
• This comprises an artificial intelligence model trained according to an embodiment of the method.
• FIG. 1 illustrates an example of a computer system
• FIG. 2 shows an exemplary computing environment where the computer system of Fig. 1 is connected;
• Fig. 3 illustrates a further example of a computer system;
• Fig. 4 shows a flow chart which illustrates a method of using the computer system of Fig. 3;
• FIG. 5 illustrates a further example of a computer system
• Fig. 6 shows a flow chart which illustrates a method of using the computer system of Fig. 5.
• Embodiments may be beneficial because they may provide for a means of reducing unwanted bias on the one or more chosen variable. This for example may enable the training of an artificial intelligence module with reduced bias although the training data set contains unwanted biases or prejudices.
• an artificial intelligence model trained to evaluate if and when maintenance of a machine should be performed There may be bias due to previous experience and personal preference in the data used to train the artificial intelligence model.
• the accuracy metric may provide a means of balancing the needs of an artificial intelligence model to provide accurate results with providing so called fair results. That is to try to eliminate unwanted bias in particular variables or in this case, the one or more chosen variables.
• the combined metric is used instead. As was just described above, this may provide for a means of removing unwanted bias in the one or more chosen variables.
• the accuracy metric could be a loss function.
• the combined metric may be used as an input to a back propagation algorithm instead of the result of the accuracy metric.
• the combined metric would be a modified loss function that combines the value of the fairness score metric with the normal or conventional loss function.
• the method further comprises providing a fairness weighted ranking for each of the multiple trained artificial intelligence models by first receiving the multiple trained artificial intelligence models.
• the multiple trained artificial intelligence models comprise an artificial intelligence model.
• the fairness weighted ranking for each of the multiple trained artificial intelligence models may for example be a ranking which identifies how much each of the multiple trained artificial intelligence models has a bias in the one or more chosen variables.
• the method further comprises receiving a testing data set for testing said multiple intelligence models.
• the testing data set comprises multiple groups of testing input data paired with a testing analysis result.
• the testing data set is essentially trial data that is used to input into each of the multiple trained artificial intelligence models.
• the method further comprises receiving a mitigation analysis result from each of said multiple artificial intelligence models in response to inputting said multiple groups of testing input data as said input data set.
• the mitigation analysis result may be considered to be the result of a trial of the multiple artificial intelligence models.
• the method further comprises calculating an accuracy score for each of the multiple trained artificial intelligence models descriptive of a comparison between the mitigation analysis result for each of the multiple trained artificial intelligence models and the testing analysis result.
• the method further comprises calculating a fairness rating metric for each of the multiple trained artificial intelligence models by comparing the one or more chosen variables to the trial analysis result.
• the accuracy score is the measure of how accurate each of the multiple trained artificial intelligence models are.
• the fairness rating metric provides a measure of how much unwanted bias there is in the one or more chosen variables for each of the multiple trained artificial intelligence models.
• the method then comprises calculating the fairness weighted ranking for each of the multiple trained artificial intelligence models by combining the fairness rating metric and the accuracy score for each of the multiple trained artificial intelligence models. So instead of ranking the multiple trained artificial intelligence models by using the accuracy score the combined accuracy score and fairness rating metric is used instead. This provides not just a value of how accurate the model is but how much unwanted bias there is in the various artificial intelligence models.
• the fairness weighted ranking may then be useful for either automated selection of the best artificial intelligence model or may be displayed to a user and a user may decide to select which model is used based on the fairness weighted ranking.
• the fairness rating metric is descriptive of a correlation between one or more chosen values of said one or more chosen variables and the trial analysis result.
• the fairness rating metric can be calculated to see if particular values of the one or more chosen variables are discriminated against. Using the example mentioned before a particular gender could be chosen and it could be seen if this particular gender results in a bias in the trained artificial intelligence models. This may be beneficial because the fairness rating metric can be used to check for particular biases in the trained artificial intelligence models.
• the multiple trained artificial intelligence models are different types.
• the multiple trained artificial intelligence models could use different neural network topologies.
• the different types could be even completely different implementations of artificial intelligence.
• One example would be where some models are neural networks and other models are Bayesian decision models. This embodiment may be beneficial because it may enable the best artificial intelligence topology and/or model type to be selected.
• one of the multiple trained artificial intelligence models is a neural network.
• one of the multiple trained artificial intelligence models is a classifier neural network.
• one of the multiple trained artificial intelligence models is a convolutional neural network.
• one of the multiple trained artificial intelligence models is a Bayesian neural network.
• one of the multiple trained artificial intelligence models is a Bayesian network.
• one of the multiple trained artificial intelligence models is a Bayes network.
• one of the multiple trained artificial intelligence models is a naive Bayes classifier.
• one of the multiple trained artificial intelligence models is a belief network.
• one of the multiple trained artificial intelligence models is a decision network.
• one of the multiple trained artificial intelligence models is a decision tree.
• one of the multiple trained artificial intelligence models is a support-vector machine.
• one of the multiple trained artificial intelligence models is a regression analysis.
• one of the multiple trained artificial intelligence models is a genetic algorithm.
• the fairness weighted ranking comprises a least squared combination of the fairness rating metric and the accuracy score.
• the fairness weighted ranking comprises a weighted least squares combination of the fairness rating metric and the accuracy score. For example, the fairness rating metric could be squared and then multiplied by a first coefficient and then the accuracy score is squared and multiplied by a second coefficient and then the two are added.
• the fairness weighted ranking comprises a linear combination of the rating metric and the accuracy score.
• the fairness weighted ranking comprises a weighted combination of the fairness rating metric and the accuracy score.
• the fairness weighted ranking comprises a polynomial combination of the fairness rating metric and the accuracy score.
• a polynomial equation could be chosen with various coefficients and then the fairness rating metric and the accuracy score could each be put into the polynomial in different combinations.
• the combined metric is an accuracy score multiplied by a scaling factor that is then raised to a predetermined power.
• the scaling factor is a function of the fairness rating metric. This embodiment may be beneficial because this has been shown to provide a good combined measure of the fairness and accuracy.
• the scaling factor is a reciprocal of the fairness rating metric.
• the fairness score metric is descriptive of a correlation between one or more chosen values of said one or more chosen variables and the trial analysis result.
• the fairness score metric is used for evaluating the artificial intelligence model during training.
• particular values of the one or more chosen values can be selected and these can be evaluated if they are discriminated against or have unwanted biases. For example, one could train the model such that a discrimination against a particular gender is avoided.
• the combined metric comprises a least squares combination of the fairness score metric and the test metric.
• the combined metric comprises a weighted least squares combination of the fairness score metric and the test metric.
• the combined metric comprises a linear combination of the fairness score metric and the test metric.
• the combined metric comprises a weighted combination of the fairness score metric and the test metric.
• the combined metric comprises a polynomial combination of the fairness score metric and the test metric.
• the combined metric comprises a constraint on the fairness score metric.
• the constraint could be limited on how large the fairness score metric is allowed to become. This may provide for a trained artificial intelligence model that has a limit on how much bias there is against a particular variable.
• the combined metric comprises a constraint on the test metric. This may for example be useful because it may be used to limit the training such that there is a minimum accuracy that is acceptable for the training. This may help to construct models that are not only fair but are also accurate.
• the combined metric comprises a maximum allowed value for the fairness score metric.
• the combined metric comprises a maximum allowed value for the test metric.
• the artificial intelligence model is a neural network.
• the artificial intelligence model is a classifier neural network.
• the artificial intelligence model is a convolutional neural network.
• the artificial intelligence model is a Bayesian neural network.
• the artificial intelligence model is a Bayesian network.
• the artificial intelligence model is a Bayes network.
• the artificial intelligence model is a naive Bayes classifier.
• the artificial intelligence model is a belief network.
• the artificial intelligence model is a decision network.
• the artificial intelligence model is a decision tree.
• the artificial intelligence model is a support-vector machine.
• the artificial intelligence model is a regression analysis.
• the artificial intelligence model is a genetic algorithm.
• the artificial intelligence model is a convolutional neural network.
• the training algorithm is a deep learning algorithm.
• the training algorithm may be a back propagation algorithm that uses the combined metric as the loss function.
• Embodiments of the present invention may be implemented using a computing device that may also be referred to as a computer system, a client, or a server.
• a computing device that may also be referred to as a computer system, a client, or a server.
• a computing device that may also be referred to as a computer system, a client, or a server.
• Fig. 1 a schematic of an example of a computer system is shown.
• Computer system 10 is only one example of a suitable computer system and is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the invention described herein. Regardless, computer system 10 is capable of being implemented and/or performing any of the functionality set forth hereinabove.
• computer system 10 there is a computer system/server 12, which is operational with numerous other general purpose or special purpose computing system environments or configurations.
• Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 12 include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed computing environments that include any of the above systems or devices, and the like.
• Computer system/server 12 may be described in the general context of computer system executable instructions, such as program modules, being executed by a computer system.
• program modules may include routines, programs, objects, components, logic, data structures, and so on that perform particular tasks or implement particular abstract data types.
• Computer system/server 12 may be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
• program modules may be located in both local and remote computer system storage media including memory storage devices.
• computer system/server 12 in computer system 10 is shown in the form of a general-purpose computing device.
• the components of computer system/server 12 may include, but are not limited to, one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including system memory 28 to processor 16.
• Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures.
• such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
• ISA Industry Standard Architecture
• MCA Micro Channel Architecture
• EISA Enhanced ISA
• VESA Video Electronics Standards Association
• PCI Peripheral Component Interconnect
• Computer system/server 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer system/server 12, and it includes both volatile and non-volatile media, removable and non-removable media.
• System memory 28 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32.
• Computer system/server 12 may further include other removable/non removable, volatile/non-volatile computer system storage media.
• storage system 34 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a "hard drive”).
• a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk")
• an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media can be provided.
• memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
• Program/utility 40 having a set (at least one) of program modules 42, may be stored in memory 28 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a networking environment.
• Program modules 42 generally carry out the functions and/or methodologies of embodiments of the invention as described herein.
• Computer system/server 12 may also communicate with one or more external devices 14 such as a keyboard, a pointing device, a display 24, etc.; one or more devices that enable a user to interact with computer system/server 12; and/or any devices (e.g., network card, modem, etc.) that enable computer system/server 12 to communicate with one or more other computing devices. Such communication can occur via Input/Output (EO) interfaces 22. Still yet, computer system/server 12 can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet) via network adapter 20. As depicted, network adapter 20 communicates with the other components of computer system/server 12 via bus 18.
• LAN local area network
• WAN wide area network
• public network e.g., the Internet
• a computer system such as the computer system 10 shown in Fig. 1 may be used for performing operations disclosed herein such as training an artificial intelligence module.
• Such computer system may be a standalone computer with no network connectivity that may receive data to be processed, such as a training data set for training an artificial intelligence module, through a local interface.
• Such operation may, however, likewise be performed using a computer system that is connected to a network such as a communications network and / or a computing network.
• Fig. 2 shows an exemplary computing environment where a computer system such as computer system 10 is connected, e.g., using the network adapter 20, to a network 200.
• the network 200 may be a communications network such as the internet, a local-area network (LAN), a wireless network such as a mobile communications network, and the like.
• the network 200 may comprise a computing network such as a cloud-computing network.
• the computer system 10 may receive data to be processed, such as a training data set for training an artificial intelligence model, from the network 200 and / or may provide a computing result, such as a trained artificial intelligence module after it has been trained using the training data set, to another computing device connected to the computer system 10 via the network 200.
• the computer system 10 may perform operations described herein, entirely or in part, in response to a request received via the network 200.
• the computer system 10 may perform such operations in a distributed computation together with one or more further computer systems that may be connected to the computer system 10 via the network 200.
• the computing system 10 and / or any further involved computer systems may access further computing resources, such as a dedicated or shared memory, using the network 200.
• Fig. 3 illustrates an idealization of the computer system 10.
• the processing unit 16 or processor of the computer 10 as well as the network adaptor 20 and the I/O interface 22 are depicted.
• the memory 28 represents the various types of memory that the processing unit 16 can access.
• the processing unit is shown as containing machine-executable instructions 300.
• the machine-executable instructions 300 are equivalent to one of the program modules 42.
• the various contents of the memory 28 may be stored in various locations such as the RAM 30, the cache 32 or in a persistent memory.
• the memory 28 is further shown as containing an artificial intelligence model 302 that has adjustable parameters.
• the artificial intelligence model may be trained to provide an analysis result in response to receiving an input data set.
• the memory 28 is further shown as containing a training data set 304 which is used for training the artificial intelligence model 302.
• the training data set 304 can be broken into groups of multiple groups of training input data 306 and a training analysis result 308 that may be available for each of the training input data.
• the training input data 306 may be input into the artificial intelligence model 302 and provide a trial analysis result 310. This is shown as being stored in the memory 28.
• the memory 28 is further shown as containing an accuracy metric 312.
• the accuracy metric 312 was calculated between the trial analysis result 310 and the training analysis result 308.
• the memory 28 is further shown as containing a fairness score metric 314 calculated by comparing one or more chosen variables of the input data set to the trial analysis result 310.
• the memory 28 is further shown as containing a combined metric 316 that was calculated by combining the fairness score metric 314 and the accuracy metric 312. The combined metric 316 is then used in conjunction with the training algorithm 318 to adjust the adjustable parameters of the artificial intelligence model 302.
• Fig. 4 shows a flowchart which illustrates a method of operating the computer 10 of Fig. 3.
• the training data set 304 is received.
• the trial analysis result 310 is received from the artificial intelligence model 302 in response to inputting the multiple groups of input training data 306 as the input data set into the artificial intelligence model 302.
• the accuracy metric 312 is calculated and it is descriptive of a comparison between the trial analysis result 310 and the training analysis result 308.
• the fairness score metric 314 is calculated by comparing the one or more chosen variables to the trial analysis result 310.
• step 408 the combined metric 316 is calculated from the fairness score metric 314 and the accuracy metric 312.
• step 410 the adjustable parameters of the artificial intelligence model 302 are modified using a training algorithm 318 that receives at least the combined metric 316 as input.
• Fig. 5 shows a further view of the computer 10.
• the features of the computer 10 depicted in Fig. 3 may be combined with the features depicted in Fig. 5.
• the memory 28 is shown as containing the machine-executable instructions 300.
• the memory is further shown as containing multiple training artificial intelligence models 500.
• the artificial intelligence model 302 depicted in Fig. 3 may possibly be one of the multiple trained artificial intelligence models 500.
• the memory 28 is further shown as containing a testing data set 502 that comprises testing input data 504 and testing analysis result 506.
• the testing data set 502 is used to test and evaluate the multiple trained artificial intelligence models 500.
• the testing input data 504 is used as the input and the output of the various artificial intelligence models is compared to the testing analysis result.
• the memory 28 is further shown as containing a mitigation analysis result.
• the mitigation analysis result 508 is the result returned by the various artificial intelligence models when the testing input data is input into them.
• the memory 28 is further shown as containing an accuracy score 510.
• the accuracy score 510 is a score which rates how accurate the mitigation analysis result 508 is to the testing analysis result 506.
• the memory 28 is further shown as containing a fairness rating metric 512 that was calculated for each of the multiple trained artificial intelligence models 500 by comparing the one or more chosen variables to the mitigation analysis result 508.
• the memory 28 is further shown as containing a fairness weighted ranking 514.
• the fairness weighted ranking 514 is a combination of the accuracy score 510 and the fairness rating metric 512.
• Fig. 6 shows a flowchart which illustrates a method of operating the computer system 10 of Fig. 5.
• the flowchart illustrated in Fig. 6 may be combined with the flowchart illustrated in Fig. 4.
• the multiple trained artificial intelligence models may be compared using the method illustrated in Fig. 6.
• the multiple trained artificial intelligence models 500 are received.
• the testing data set 502 is received.
• the mitigation analysis result 508 is received by inputting the testing input data 504 into the various trained artificial intelligence models 500.
• step 606 the accuracy score 510 is calculated for each of the multiple trained artificial intelligence models 500 by comparing the mitigation analysis result 508 for the particular intelligence models 500 and the testing analysis result 506.
• step 608 the fairness rating metric 512 is calculated for each of the multiple trained artificial intelligence models 500 by comparing the one or more chosen variables to the mitigation analysis result 508.
• step 610 the fairness weighted ranking 514 is calculated for each of the multiple trained artificial intelligence models 500 by combining the fairness rating metric 512 and the accuracy score 510.
• the automatic machine learning approach is very popular nowadays. It allows to automate manual data scientist work and speed up the model development process. Unfortunately finding the best model may require a significant amount of time and resources. The goal of automatic machine learning processes is to find the most accurate model.
• Embodiments may inject bias checking and mitigation procedures to automatic machine learning processes.
• the procedures are based on a scorers concept.
• Example systems may possibly be based on two modules a detection model (used for calculating the combined metric to modify the adjustable parameters of the artificial intelligence module) and a mitigation module (to provide the fairness rating metric for the multiple trained artificial intelligence modules). Modules can be used separately or together.
• the detection module may be based on extending a regular scorers list by a fairness calculation scorer (fairness rating metric).
• a scorer function (referred to herein as an accuracy score) is used to evaluate a machine learning model (artificial intelligence model).
• Sample scorers include accuracy, the Brier score loss, average precision, balanced accuracy, fl score, and others.
• autoML automatic ML
• the scorer is used to optimize the search process, so that the model with the best scorer value is found.
• the scorers are machine learning scorers describing performance (accuracy) of the model. These are referred to as “ml_scorers” herein.
• this module there is an extended list of scorers by adding fairness metric scorers (fairness score metric) to the process.
• fairness score metric fairness score metric
• new types scorers have been injected to exsisting ML architectures. This is referred to as a “fairness scorer” or fairness score metric herein.
• a fairness scorer or fairness score metric herein.
• Each time the ml scorer is calculated the “fairness scorer” (since added to the scorers list) may be executed as well.
• fairness score metric is calculated.
• the fairness score metric is referred to herein as the disparate impact and is calculated under “faimess_metrics” category.
• fairness info This information about possible biases or prejudices is referred to as “fairness info” herein. Fairness info examples and explanation and is described below. This information is passed to autoML system as a parameter and the fairness score metric is calculated for each stage of the detection module based on that information. An exemplary call of the system in pseudocode with fairness info is presented below:
• accuracy refers to the type of accuracy metric used.
• the “training data” corresponds to the training input data and the “training labels” corresponds to the training analysis result.
• the protected attributes of the fairness info below correspond to the one or more chosen variables.
• the “privileged groups” of the “protected attributes” corresponds to the one or more chosen values of the one or more chosen variables.
• the “disparate impact” is the “fairness score metric” and “the accuracy and disparate impact” is the “combined metric.”
• the mitigation module is again based on a scorer approach.
• the so-called combined scorer is introduced once more.
• the combined scorer that combines both ML (accuracy score) and a fairness metric (fairness rating metric) based on some weights and is also referred to herein as the fairness weighted ranking or ‘ accuracy and disparate impact scorer’ herein.
• ML accuracy score
• fairness rating metric fairness rating metric
• One of the combined scorers is a fairness scorer (fairness rating metric) and is analogous to the fairness score metric of the detection module, it may be calculated with all autoML system steps and uses provided fairness info also. Final value of the combined scorer depends on the disparate impact ratio:
• fairness rating metric is NaN (not a number such as is caused by division by zero)
• the fairness info is not suitable for the dataset sample (e.g. sample from k-fold cross-validation) the second metric from combined metrics is returned, for instance accuracy.
• Scaling factor depends on disparate impact threshold, that is a parameter set to 0.9 (values above this threshold are considered fair) and symmetric impact value, that is a parameter described below.
• disparate impact threshold that is a parameter set to 0.9 (values above this threshold are considered fair)
• symmetric impact value that is a parameter described below.
• scaling_factor (symmetric impact)/(disparate impact threshold)
• scaling hardness is a parameter set to 4.0.
• the “disparate impact” is the “fairness rating metric” and the “accuracy and disparate impact” is the “fairness weighted ranking.”
• model ranking can be also done for ease of interpretation using both metrics (separated): machine learning metric like accuracy and fairness metric like disparate impact. That allows for a useful presentation to the end user and the ability to rank and/or sort based on the selected metric.
• That selection can also be easily extended to filtering based on some thresholds.
• the user set constraints, for example, that provide the best fairness pipeline but with a precision not less than 0 8
• the present invention may be a system, a method, and/or a computer program product at any possible technical detail level of integration
• the computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention
• the computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device.
• the computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
• a non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing.
• RAM random access memory
• ROM read-only memory
• EPROM or Flash memory erasable programmable read-only memory
• SRAM static random access memory
• CD-ROM compact disc read-only memory
• DVD digital versatile disk
• memory stick a floppy disk
• a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon
• a computer readable storage medium is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber optic cable), or electrical signals transmitted through a wire.
• Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network.
• the network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
• a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
• Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuitry, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++, or the like, and procedural programming languages, such as the "C" programming language or similar programming languages.
• the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
• the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
• electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
• These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
• These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
• the computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
• each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
• the functions noted in the blocks may occur out of the order noted in the Figures.
• two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
• a method of training an artificial intelligence model wherein the artificial intelligence model has adjustable parameters, wherein said artificial intelligence model is trained to providing an analysis result in response to receiving an input data set, wherein said input data set comprises one or more chosen variables
• said method comprising: receiving a training data set for training said artificial intelligence model, wherein said training data set comprises multiple groups of training input data paired with a training analysis result; receiving a trial analysis result from said artificial intelligence model in response to inputting said multiple groups of training input data as said input data set into said artificial intelligence model; calculating an accuracy metric descriptive of a comparison between said trial analysis result and said training analysis result; calculating a fairness score metric by comparing said one or more chosen values to said trial analysis result; calculating a combined metric from said fairness score metric and said accuracy metric; modifying the adjustable parameters of the artificial intelligence model using a training algorithm that receives at least said combined metric as input.
• said method further comprises providing a fairness weighted ranking for each of multiple trained artificial intelligence models by: receiving said multiple trained artificial intelligence models, wherein said multiple trained artificial intelligence models comprise said artificial intelligence model; receiving a testing data set for testing said multiple intelligence models, wherein said testing data set comprises multiple groups of testing input data paired with a testing analysis result; receiving a mitigation analysis result from each of said multiple artificial intelligence models in response to inputting said multiple groups of testing input data as said input data set; calculating an accuracy score for each of said multiple trained artificial intelligence models descriptive of a comparison between said mitigation analysis result for each of said multiple trained artificial intelligence models and said testing analysis result; calculating a fairness rating metric for each of said multiple trained artificial intelligence models by comparing said one or more chosen values to said trial analysis result; and calculating said fairness weighted ranking for each of said multiple trained artificial intelligence models by combing said fairness rating metric and accuracy score for each of multiple trained artificial intelligence models.
• each of said multiple trained artificial intelligence models are independently any one of the following: a neural network, a classifier neural network, a convolutional neural network, a Bayesian neural network, a Bayesian network, a Bayes network, naive Bayes classifiers, belief network, or decision network, a decision trees, a support-vector machine, a regression analysis, and a genetic algorithm.
• said fairness weighted ranking comprises any one of the following: a least squares combination of said fairness rating metric and said accuracy score, weighted lease squares combination of said fairness rating metric and said accuracy score, a linear combination of said fairness rating metric and said accuracy score, a weighted combination of said fairness rating metric and said accuracy score, and a polynomial combination of said fairness rating metric and said accuracy score.
• Clause 7 The method of any one of clauses 2 to 5, wherein said combined metric is said accuracy score multiplied by a scaling factor raised to a predetermined power, wherein said scaling factor is a function of said fairness rating metric.
• Clause 11 The method of clause 9 or 10, wherein said combined metric comprises any one of the following: a constraint on said fairness score metric, a constraint on said test metric, a maximum allowed value for said fairness score metric, and a maximum allowed value for said test metric.
• said artificial intelligence model is any one of the following: a neural network, a classifier neural network, a convolutional neural network, a Bayesian neural network, a Bayesian network, a Bayes network, naive Bayes classifiers, belief network, or decision network, a decision trees, a support-vector machine, a regression analysis, and a genetic algorithm.
• Clause 13 The method of any one of clauses 1 to 12, wherein said artificial intelligence model is a convolutional neural network, and wherein said training algorithm is a deep learning algorithm.
• Clause 14 A computer program product comprising a computer- readable storage medium having computer-readable program code embodied therewith, said computer-readable program code configured to implement the method of any one of clauses 1 to 13.
• a computer system comprising: a processor configured for controlling the computer system; and a memory storing machine executable instructions, wherein execution of said instructions causes said processor to: receive a training data set for training an artificial intelligence model, wherein the artificial intelligence model has adjustable parameters, wherein said artificial intelligence model is trained to providing an analysis result in response to receiving an input data set, wherein said input data set comprises one or more chosen variables wherein said training data set comprises multiple groups of training input data paired with a training analysis result, receive a trial analysis result from said artificial intelligence model in response to inputting said multiple groups of training input data as said input data set into said artificial intelligence model, calculate an accuracy metric descriptive of a comparison between said trial analysis result and said training analysis result, calculate a fairness score metric calculated by comparing said one or more chosen values to said trial analysis result, calculate a combined metric from said fairness score metric and said accuracy metric, modifying the adjustable parameters of the artificial intelligence model using a training algorithm that receives at least said combined metric as input.
• execution of the instructions further causes said processor to: receive said multiple trained artificial intelligence models, wherein said multiple trained artificial intelligence models comprises said artificial intelligence model; receive a testing data set for testing said multiple intelligence models, wherein said testing data set comprises multiple groups of testing input data paired with a testing analysis result; receive a mitigation analysis result from each of said multiple artificial intelligence models in response to inputting said multiple groups of testing input data as said input data set, calculate an accuracy score for each of said multiple trained artificial intelligence models descriptive of a comparison between said mitigation analysis result for each of said multiple trained artificial intelligence models and said testing analysis result, calculate a fairness rating metric for each of said multiple trained artificial intelligence models by comparing said one or more chosen values to said trial analysis result; and calculate said fairness weighted ranking for each of said multiple trained artificial intelligence models by combing said fairness rating metric and accuracy score for each of multiple trained artificial intelligence models.
• Clause 17 The computer system of any one of clauses 15 to 16, wherein the artificial intelligence model is any one of the following: a neural network, a classifier neural network, a convolutional neural network, a Bayesian neural network, a Bayesian network, a Bayes network, naive Bayes classifiers, belief network, or decision network, a decision trees, a support-vector machine, a regression analysis, and a genetic algorithm.
• the artificial intelligence model is any one of the following: a neural network, a classifier neural network, a convolutional neural network, a Bayesian neural network, a Bayesian network, a Bayes network, naive Bayes classifiers, belief network, or decision network, a decision trees, a support-vector machine, a regression analysis, and a genetic algorithm.
• Clause 18 The computer system of any one of clauses 15 to 17, wherein said artificial intelligence model is a convolutional neural network, and wherein said training algorithm is a deep learning algorithm.
• Clause 19 A computer program product, said computer program product comprising a computer readable storage medium having stored thereon an artificial intelligence model trained according to the method of any one of clauses 1 through 12
• Clause 20 A memory for storing data for access by an application program being executed on a data processing system, comprising: an artificial intelligence model trained according to the method of any one of clauses 1 through 12.
• a method of providing a fairness weighted ranking for each of multiple trained artificial intelligence models comprises: receiving said multiple trained artificial intelligence models; receiving a testing data set for testing said multiple intelligence models, wherein said testing data set comprises multiple groups of testing input data paired with a testing analysis result; receiving a mitigation analysis result from each of said multiple artificial intelligence models in response to inputting said multiple groups of testing input data as said input data set; calculating an accuracy score for each of said multiple trained artificial intelligence models descriptive of a comparison between said mitigation analysis result for each of said multiple trained artificial intelligence models and said testing analysis result; calculating a fairness rating metric for each of said multiple trained artificial intelligence models by comparing said one or more chosen values to said trial analysis result; and calculating said fairness weighted ranking for each of said multiple trained artificial intelligence models by combing said fairness rating metric and accuracy score for each of multiple trained artificial intelligence models.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Health & Medical Sciences (AREA)
• Computing Systems (AREA)
• Biomedical Technology (AREA)
• Biophysics (AREA)
• Computational Linguistics (AREA)
• Data Mining & Analysis (AREA)
• Evolutionary Computation (AREA)
• Life Sciences & Earth Sciences (AREA)
• Molecular Biology (AREA)
• Artificial Intelligence (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Mathematical Physics (AREA)
• Software Systems (AREA)
• Health & Medical Sciences (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
• Complex Calculations (AREA)

Priority Applications (1)

Applications Claiming Priority (2)

Publications (1)

Family

ID=84284694

Family Applications (1)

Country Status (3)

Families Citing this family (3)

Citations (8)

Family Cites Families (6)

• 2021
  • 2021-06-07 US US17/303,732 patent/US20220391683A1/en active Pending
• 2022
  • 2022-06-01 JP JP2023570346A patent/JP2024520312A/ja active Pending
  • 2022-06-01 WO PCT/IB2022/055104 patent/WO2022259089A1/en not_active Ceased

Patent Citations (8)

Also Published As

Similar Documents

Legal Events