The widespread growth and prevalence of machine learning models for crucial decision-making tasks has raised questions on the fairness of the underlying models. Machine learning models have been mostly employed as a black box with little or no transparency or they are too complex to comprehend for non-experts, which further exacerbates this problem. This has led to an increased interest in creating fair machine learning models. The goal of fairness-aware machine learning is to ensure that the decisions made by models do not discriminate against a certain group(s) of individuals [12, 13, 4].
Fairness has been well studied in the social science and policymaking domains [3] and is emerging as an important area of research in computer science and specifically, the machine learning community. Most existing work on fairness focus on developing metrics to remove biases after prediction and identifying and removing sensitive attributes [13, 15, 22] . There is limited existing work on fairness in relational domains. Farnadi et al.’s [10] work on developing fairness metrics for relational domains and fairness-aware MAP inference for hinge-loss Markov random fields (HL-MRFs) [2] is the first work in this direction. Farnadi et al. [10] note that in many social contexts, discrimination is the result of complex interactions and cannot be described solely in terms of attributes of an individual. While this process is helpful in removing the biases in the inference procedure, it
ignores the structural biases in the model structure. This is especially relevant for relational models, where the model structure is instrumental in obtaining the predictions and the biases ingrained in the structure are harder to detect and eliminate. Contributions In this work, we develop Fair-A3SL, a fairness-aware structure learning algorithm for hinge-loss Markov random fields (HL-MRFs). Fair-A3SL extends a recently developed deep reinforcement learning-based structure learning algorithm for HL-MRFs, A3SL [26], to automatically learn fair relational graphical model structures. Fair-A3SL has the ability to encode almost all different state-of-the-art widely-used fairness metrics: equalized odds [13], equal opportunity [13], statistical parity difference [16], recently developed relational fairness measures of risk difference, risk reward, and relative chance [10], and fairness measures for collaborative fil-tering, non-parity and overestimation [23]. Fair-A3SL possesses the ability to encode multiple model-based and post-processing fairness measures in a single algorithm and can jointly optimize for them to learn a fair model structure. It also offers flexibility in encoding and enforcing these measures through user-defined coefficients that capture the impact of these measures, therefore providing the much needed customizability to enable applicability across multiple domains. The added strength of Fair-A3SL arises from its ability to learn interpretable fair structures that do not compromise on performance, further alleviating the problem of opaqueness and lack of interpretability in machine learning models. To the best of our knowledge, ours is the first approach that directly focuses on learning fair relational model structures from data.
In our experiments, we demonstrate Fair-A3SL’s versatility in being able to encode many different fairness measures and learn fair models for multiple domains. We evaluate the effectiveness of our learned structures in three datasets: i) paper review dataset, a relational dataset used in Farnadi et al. [10] that showcases the ability of our models to learn fair network and collective model structures, ii) Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) dataset, a popular dataset used in many existing fairness work allowing us to compare Fair-A3SL with many state-of-the-art fairness models, and iii) MovieLens dataset, a popular dataset used in recommender systems, that enables us to integrate fairness measures used in collaborative filtering in Fair-A3SL. Fair-A3SL is able to learn structures that eliminate bias at the structure level, requires minimal pre-processing (no other pre-processing other than what is needed for computing the fairness metrics), and can potentially be used easily in sensitive applications to learn interpretable, expressive, and fair model structures that possess good prediction performance for making accurate predictions.
The state-of-the-art bias mitigation algorithms can be grouped into three categories that include pre-processing, model-based, and post- processing methods. Pre-processing methods work by directly mitigating the bias in the training data itself. Examples of this approach include optimized preprocessing [6], which modifies training data features and labels, reweighting [14], which modifies the weights of different training examples, disparate impact remover [12], which edits feature values to improve group fairness, and learning fair representations [24], which learns fair representations by obfuscating information about protected attributes.
Model-based methods are used to mitigate bias in classifiers; for example, adversarial debiasing [25] uses adversarial techniques to maximize accuracy and reduce evidence of protected attributes in predictions. Prejudice remover [16] adds a discrimination-aware regularization term to the learning objective. Meta Fair Classifier [7] takes the fairness measure as part of the input and returns a classifier optimized for that metric. Our approach falls in this category. Existing approaches only learn the parameter values or apply regularization to lessen the effect of sensitive attributes. The fairness measures are not used to directly induce the structure, hence leaving behind some possibility of bias. Our approach differs from existing approaches in that it directly learns the graphical model structure by optimizing for the fairness measures. Thus, our approach is capable of mitigating structural bias in the model, which helps in creating an overall fairer model.
The third class of algorithms focus on post-processing methods to mitigate bias in predictions. For example, reject option classification [15] changes predictions from a classifier to make them fairer. Equalized odds post-processing [13] modifies the predicted labels using an optimization scheme to make predictions fairer. Calibrated equalized odds post-processing [22] optimizes over calibrated classifier score outputs that lead to fair output labels.
Before delving into the details of Fair-A3SL, we provide necessary background on hinge-loss Markov random fields (HL-MRFs) [2], the probabilistic programming templating language for encoding them, Probabilistic Soft Logic (PSL) [2], and a recently developed structure learning algorithm for learning interpretable relational structures in HL-MRFs, asynchronous advantage actor-critic for structure learning (A3SL) [26].
3.1 Hinge-loss Markov Random Fields
HL-MRFs are a recently developed scalable class of continuous, conditional graphical models [2]. HL-MRFs can be specified using Probabilistic Soft Logic (PSL) [2], a first-order logic templating language. In PSL, random variables are represented as logical atoms and weighted rules define dependencies between them of the form: , where P, Q, and R are predicates, a and b are variables, and
is the weight associated with the rule. The weight of the rule r indicates its importance in the HL-MRF model, which is defined as
where P(Y |X ) is the probability density function of a subset of logical atoms Y given observed logical atoms X, is a hinge-loss potential corresponding to an instantiation of a rule r, and is specified by a linear function
and optional exponent
admit tractable MAP inference regardless of the graph structure of the graphical model, making it feasible to reason over complex user-specified dependencies. This is possible because HL-MRFs operate on continuous random variables and encode dependencies using potential functions that are convex, so MAP inference in these models is always a convex optimization problem. Farnadi et al. [10] extend the MAP inference algorithm to be able to maximize the a-posteriori values of unknown variables subject to fairness guarantees.
Our approach to learning fair structures focuses on learning logical constructs that particularly bring out the modeling capabilities in HL-MRFs. Below, we provide examples from two datasets we use in our experiments, a relational paper review dataset and a correctional center recidivism prediction dataset: 1. Relational Dependencies and Collective Rules: highQuality(P) positiveReviews(R
,P)
positiveReviews(R
,P), which captures if paper P is of high quality and reviewer R
gives the paper a positive review, then reviewer R
also gives the paper a positive review. Note that positiveReviews is a target predicate and this rule collectively predicts it for both the reviewers. 2. Feature Dependencies: priorFelony(U,
africanAmerican(U)
recidivism(U), which captures (unfairly) that if user U has committed a prior felony I and the race of the user is African American, the user has a higher chance of recidivism. These two features come together to predict recidivism.
3.2 Asynchronous advantage actor-critic structure learning (A3SL) for HL-MRFs
Asynchronous advantage actor-critic structure learning algorithm (A3SL) [26], a recently developed structure learning algorithm for HL-MRFs, adapts a neural policy gradient algorithm asynchronous advantage actor-critic (A3C) [20] for the structure learning problem. A3SL learns interpretable and expressive structures for HL-MRFs by finding the clause set C and corresponding weight vector that maximizes the objective:
Interpretability Priors, where L(Y, X) is the HL-MRF probability density, logP(Y |X), given by Equation 1. Interpretability Priors consist of a combination of priors on the total number of clauses, the maximum possible length of a clause, and domain-specific semantic constraints. The inclusion of semantic constraints and a performance-based utility function allows the algorithm to learn structures that are interpretable and data-driven, thus optimizing for both while being able to rectify any domain-specific intuitions that are not true in the data. The objective function
is defined as,
where parameters denote the strength of the different constraints,
denotes the weight for PSL clause c, and Dist(c) denotes the deviation of clause c from semantic constraints (discussed more in Section 4.4). We refer the reader to [26] for additional details.
In this section, we develop Fair-A3SL by incorporating the different fairness measures in the A3SL problem formulation and objective. We first introduce the Fair-A3SL algorithm and then describe all the fairness-related components in the algorithm in detail in the following sections.
4.1 Fair-A3SL algorithm
Algorithm 1 gives the Fair-A3SL algorithm. The algorithm follows an actor-critic reinforcement learning setup to learn the clause list C at each step. Our environment consists of predicates for features (denoted by X), target variables (Y), and data corresponding to X and ground truth data for Y. And each intermediate state at time t comprises of either a partially constructed or a complete set of first order logic clauses, denoted by C. Our action space is defined by all the predicates X, Y, and their negative counterparts, and a special token END. At time t, action
adds a new predicate to the current clause or chooses to return the clause by adding an END.
In the Fair-A3SL algorithm, we present two main ways of encoding the fairness measures: i) as MAP inference constraints, and ii) as priors in the objective function. The fairness measures encoded as constraints are integrated as linear inequality constraints in the MAP inference for HL-MRFs; we present more details in Section 4.2. Step 6 in Algorithm 1 captures this step, where fairness-aware inference subject to the fairness MAP inference constraints is performed.
To include fairness measures as priors, we turn to the reward/utility function in Step 7 of Algorithm 1. The immediate reward is equal to the value of objective function at step t if the clause set construction is complete;
equals 0 otherwise. The cumulative reward
is equal to the value of the objective function, where
is the discount factor, and we set it to 1 in all our experiments. The fairness measures encoded as priors are integrated in the reward utility function, the new utility after incorporating the priors becomes Utility
fairness priors, where P(Y |X ) is the HL-MRF objective given by Equation 1 and
denotes the strength of the fairness prior(s). The algorithm returns the clause list with the best accumulated reward calculated using the utility function as the optimal clause list
4.2 Fairness aeasures as MAP inference constraints
Here, we discuss how to integrate different fairness measures as MAP inference constraints. First, we start with the assumption that we are given a dataset consisting of n samples . Here, A denotes one or more sensitive attributes such as gender and race, X denotes other non-sensitive features, and Y denotes the ground-truth labels. We group instances or users based on their sensitive attributes into two groups, protected and unprotected. We then de-fine,
protected group
unprotected group
,
protected group
unprotected group|.
refers to a positive prediction (e.g., acceptance) and
refers to a negative prediction (e.g., denial) from the trained model. The proportions of denial for protected and unprotected groups are
respectively, where
are constants [10, 21].
measures can be defined in terms of and
as follows, where
Risk difference: RD Risk Ratio: RR
Relative Chance: RC
The -fairness constraints above translate to six linear inequality constraints in the HL-MRF framework. For example, the linear inequality constraints
defined for satisfying the inequality
RD
have the forms shown below, where
,...,
are instances in the protected group, and
are instances in the unprotected group, and the total number of instances
l
Next, we consider a fairness metric for collaborative filtering [23]: non-parity unfairness. Non-parity unfairness is defined as the absolute difference between the overall predicted average ratings of protected users and those of unprotected users: unprotected
where is the prediction,
is the total rating by protected users and
the total rating by unprotected users. Below, we demonstrate how to capture non-parity unfairness in Fair-A3SL as a MAP inference constraint. We get the corresponding
-fairness linear inequality constraints
and
below, where n represents number of users u, m represents number of items v.
The linear form of the constraints is consistent with MAP inference in HL-MRF model; they can be seamlessly solved using a consensusoptimization algorithm based on the alternating direction method of multipliers (ADMM) [5]. To accomplish this, we extend the consensus optimization algorithm by Bach et al. [2] for MAP inference in HLMRFs to include above defined fairness linear inequality constraints.
Similarly, other fairness measures can also be incorporated in the Fair-A3SL framework as constraints. Statistical Parity Difference measures the difference of the rate of favorable outcomes received by the unprivileged group to the privileged group [16] and Disparate Impact measures the ratio of rate of favorable outcome for the unprivileged group to that of the privileged group [12]. Both these measures are similar to the relative chance (RC) relational measure and can be encoded similarly.
4.3 Fairness measures as objective priors
While certain fairness measures can be modeled as MAP inference constraints in the framework, the post-processing fairness measures can only be modeled as priors in our objective due to the absence of ground truth for target Y at test time as discussed below.
Equalized Odds Difference [13] measures the difference of false positive rate and true positive rate between unprivileged and privileged groups, which can be defined as is the predicted value and Y is the ground truth. We cannot directly incorporate this measure as a MAP inference constraint since at test time the true value of Y is not available. This measure and other similar post-processing measures that rely on true ground-truth labels can be encoded as priors in the Fair-A3SL algorithm. We integrate the priors in the objective function, which then is used in computing the agent’s rewards in the Fair-A3SL algorithm as discussed in Section 4.1.
Overestimation unfairness measures inconsistency in how much the predictions overestimate the true ratings [23]. This fairness measure is used in the collaborative filtering setting. Following equations give the formula for and the expectation for the protected group
The average for Eunprotected is computed analogously.
Equal Opportunity Difference measures the difference of true positive rates between the unprivileged and the privileged groups [13]. Average Odds Difference [1] measures the average difference of false positive rate and true positive rate between unprivileged and privileged groups. These measures are comparable to the Equalized Odds Difference measure and can be similarly encoded as priors.
4.4 Domain-specific semantic constraints
An interpretable model lays the foundation for fairness and transparency. In addition to inducing fairness-aware relational structures, we also include semantically meaningful domain constraints that do not contain any structural bias and encourage the algorithm to learn interpretable structures. This is helpful in making the resulting model more appealing to end users. Here, we show how to group predicates and their negative counterparts into two categories, positive signals and negative signals using the semantic interpretation of the predicate. If the user is unsure about the semantics of any predicate, they can be incorporated in both the categories to avoid any unintentional bias.
Table 1: Right reasons identified from domain semantics
We illustrate this using the COMPAS dataset, one of the datasets widely used in fairness studies and also in our experiments. We capture positive signals P={priorFelonHistory, priorMisdemeanorHistory, priorOtherHistory, juvFelonHistory, juvMisdemeanorHistory, juvOtherHistory, priors, felony, recidivism, longJailDay,
longJailDay} that capture tendency toward recidivism and negative signals N={
recidivism, oldAge, longJailDay,
longJailDay} that capture tendency against recidivism. Since at first we are not sure about the effect of longJailDay and its negative counterpart on recidivism prediction from domain knowledge, we place it in both categories. The domain-specific semantic constraints have the general structure in Table 1, where positive signals
signals
, and any positive signal
, negative signal
. We use a distance function, Dist(c) to capture if the learned clause structure complies with or deviates from the right reasons identified by the expert: Dist(c) = 0, if the clause complies with the right reasons and Dist(c) = 1, otherwise. This distance function is then integrated in the objective functions discussed in Section 4.5. If the domain-specific guidance is not readily available for the specific domain, the model is able to work without them as well as they are added only to enhance interpretability when appropriate.
4.5 Fair-A3SL objective functions
We present two different objective functions that we use across our three predictive modeling scenarios that demonstrates how a combination of fairness constraints, fairness priors, and semantic constraints can be represented in an objective function. This objective can be easily modified to include/exclude specific fairness/semantic constraints or fairness priors.
4.5.1 Fair-A3SL objective for relational models
In the first objective, we use a combination of fairness measures both encoded as constraints and as priors. Here, we encode the relational fairness measures RR, RC, and RD as MAP inference constraints and the equalized odds difference measure as a prior in the objective along with interpretability priors for the specific domain in question. Equation 3 gives the Fair-A3SL objective function corresponding to this combination. We use this objective function in our experiments in Section 5.1 on the relational dataset and in Section 5.2 on the recidivism prediction dataset.
where refers to the equalized odds difference fairness measure and
captures its degree of enforcement.
4.5.2 Fair-A3SL objective for recommender systems
For the recommender systems problem, we turn to the corresponding fairness measures of overestimation and non-parity. Equation 4 gives the Fair-A3SL objective for recommender systems. As is evident from the equation, here again we include a combination of constraints and priors in the objective; we incorporate the non-parity fairness measure as a MAP inference constraint () and overestimation as an objective prior (
). We use this objective for the experimental results in Section 5.3.
4.6 Highlights of Fair-A3SL
Our approach to fairness is versatile in its ability to encode many different fairness measures toward directly learning the graphical model structure. Fair-A3SL provides the capability of encoding fairness measures as constraints and/or as priors and has minimal pre-processing requirements (only those imposed by the underlying fairness measures). While many existing work indicate the importance of combining fairness measures for practitioners, they also note that there is often a trade-off between various fairness measures and it is challenging to construct a single fairness objective that performs well across different measures [23, 11]. While this remains true for con-flicting measures, Fair-A3SL is a step in the right direction, where we present a platform that can incorporate a combination of fairness metrics while simultaneously optimizing for them. In Equations 3 and 4, we show some possible combinations and our results indicate Fair-A3SL can indeed optimize for multiple fairness metrics at the same time. These desirable qualities in Fair-A3SL can potentially help downstream users such as policy makers and decision making organizations (e.g., bank loans, student admissions) to successfully adopt the framework.
We conduct experiments to evaluate the learned structures quantitatively and qualitatively on three fairness datasets. In our experiments, we illustrate the capability of Fair-A3SL to be able to: i) learn fair network and collective structures that bring out the modeling power of statistical relational models, ii) incorporate a wide range of fairness measures and learn model structures using them, and iii) learn model structures that outperform state-of-the-art fairness models both across performance and fairness metrics and are qualitatively meaningful. The Fair-A3SL code and the code for experiments will be made publicly available when the paper is accepted for publication. The best scores and those that are statistically indistinguishable from the best are typed in bold in all the results. All experiments use 5-fold cross-validation.
5.1 Results on relational paper review dataset
We first present results on a paper reviewing problem that can potentially be biased by the author’s affiliation instead of the quality of the paper. We follow Farnadi et al. [10] to generate a similar dataset to theirs in order to facilitate a direct comparison. Table 2 gives the conditional probability distribution table (left) and the
Table 2: Generation model of the paper review dataset: left shows the joint probability distribution of variables and right shows the graphical model. Q: indicates whether or not the paper is high quality; H: indicates whether or not the author is affiliated with a top-rank institute; S: indicates whether or not the author is a student; R1, R2: indicates whether or not the first/second reviewer gives the paper a positive review.
Bayesian network (right) that we use for generating the data. Two specific scenarios parametrized by P(H) that determine the degree of discrimination are: i) probability of the paper receiving a favorable rating given the paper is of high quality and the author is not from a top ranked institution (), and ii) probability of the paper receiving a favorable reviewer rating given the paper is of high quality and the author is from a top ranked institution (
. We introduce bias in the data when the author is a student (S = T) by setting
and
. We set
and
to 0.85. The train and test dataset both contain data generated using the Bayesian network comprising of 100 papers, 100 authors, 30 reviewers, and each paper is reviewed by 2 random reviewers.
Table 3: Fairness-A3SL Model on Paper-Review Dataset
Table 3 gives the learnt rules the Fair-A3SL model on the paper review dataset. To enable a comparison with Farnadi et al. [10], we also enhance A3SL by adding the ability to encode collective rules. Collective rules jointly predict two or more target variables. Note that the learned model structure is expressive, learning different kinds of rules: network, collective, and combination of features.
We compare Fair-A3SL with the following state-of-the-art baselines: i) Fair-PSL [10], manually-defined PSL rules with fairness constraints in inference, ii) Sensitive-PSL, manually-defined PSL rules with no fairness constraints, and iii) Sensitive-A3SL [26], a model structure learned using A3SL with no fairness constraints or priors. Additionally, we experiment with three versions of Fair-A3SL that use different combinations of fairness measures. Fair-A3SL
Table 4: Comparison of Fair-A3SL with baselines on Area under PR curve and ROC curve
Table 5: Comparison of Fair-A3SL with baselines on fairness measures
cludes fairness constraints without equalized odds priors. Fair-A3SLincludes fairness constraints along with equalized odds priors with
. Fair-A3SL
includes fairness constraints along with equalized odds with
. We set
-fairness=0.1 for all fairness inference inequality constraints. The AUC-ROC values from the Sensitive-A3SL model can be considered an upper bound, as it is a purely data-driven model.
Our specific focus is on the prediction performance for protected/unprotected groups, especially for predicting a positive outcome in both these groups (Table 4). We report area under the AUCPR curve for the positive class (positiveSummary). From the table, we can see that all A3SL versions outperform the human expert counterparts (Sensitive-A3SL vs. Sensitive-PSL, Fair-A3SL versions vs. Fair-PSL). We can see that the Fair-PSL model even when the fairness measures are included in the inference only achieves a prediction performance of , while the Fair-A3SL models achieve > 0.6 for the protected group. The Fair-A3SL models also improve the prediction performance of the unprotected groups when compared to the Fair-PSL model. The combined AUC-ROC value for the Fair-A3SL models is also closer to the models that include sensitive attributes (Sensitive-PSL and Sensitive-A3SL). Similarly, all the Fair-A3SL models achieve better or comparable performance across all fairness metrics (RD, RR, RC, Equalized Odds Positive and Negative) when compared with Fair-PSL with manually defined rules (Table 5). Particularly, for the equalized odds measures, Fair-A3SL models clearly outperform Fair-PSL. We also observe that we get better results for the equalized odds fairness measure when we increase the value of
Thus, Fair-A3SL is able to achieve fairness without compromising on performance.
5.2 Results on COMPAS dataset
The Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) tool produces a risk score that predicts a person’s likelihood of committing a crime in the next two years [19]. The output is a score between 1 to 10 that maps to low, medium, or high. We collapse this to a binary prediction: a score of 0 corresponds to a prediction of low risk according to COMPAS, while a score of 1 indicates high or medium risk. The dataset also contains information on recidivism for each person over the next two years, which we use as ground truth. Existing work shows that the COMPAS risk scores discriminate against black defendants, who were predicted to be far more likely than white defendants to be incorrectly judged to be at a higher risk of recidivism, while white defendants were more likely than black defendants to be incorrectly flagged as low risk [19, 9].
Table 6 gives the Sensitive-A3SL model. We can see that the model combines other recidivism signals of having committed prior felonies (priors and priorFelony) with the race attribute (africanAmerican), indicating how the race attribute and combinations with it are predictive of recidivism and are a natural albeit unfair and discriminatory choice for models that are solely performance driven. The rules learned by the Fair-A3SL model are given in Table 7. Parameter U represents user, represents a felony instance. For example, priorFelonHistory(U,
can be grounded with multiple historical felony instances
user U. Fair-A3SL’s transparency, interpretability, expressibility,
Table 6: Representative rules from Sensitive-A3SL model
along with fairness, makes it an ideal candidate for automatically learning prediction models for sensitive domains.
We compare Fair-A3SL with recently developed state-of-the-art fairness models: i) Calibrated Equalized Odds [22], ii) Prejudice Remover [16], iii) Optimized Pre-processing [6], iv) Adversarial Debiasing [25], and v) Line-FERM [8], where Calibrated Equalized Odds, Prejudice Remover, and Optimized Preprocessing use logistic regression as the backend model; Adversarial Debiasing uses a deep learning neural network model; and FERM uses SVM as the underlying model. Table 8 gives the 5-fold cross-validation results and shows
Table 8: AUC-PR curve and ROC values for state-of-the-art fairness models and Fair-A3SL for COMPAS dataset.
Table 9: Comparison of performance of Fair-A3SL with state-of-the-art fairness models on different fairness metrics for COMPAS dataset
that Fair-A3SL is able to achieve a better prediction performance for both the protected and unprotected groups, individually (AUC-PR for protected and unprotected groups) and combined (AUC-ROC). We use the IBM AI Fairness 360 tool [1] for running the existing state-of-the-art models. We also demonstrate that our learned model outperforms the state-of-the-art fairness models in the fairness metrics as well, achieving the best scores across all metrics (Table 9).
5.3 Results on Movielens dataset
In the third experiment, we consider another important domain for fairness, recommender systems. To evaluate the effectiveness of Fair-A3SL in recommender systems, we use the MovieLens 100k dataset. It consists of ratings from 1 to 5 by 943 users for 1682 movies. The users are annotated with demographic variables such as gender, and the movies are each annotated with a set of genres. For convenience, we convert the ratings to range between values 0 and 1. From Table 10, we can see that women rate musical and romance films higher and more frequently than men. Men rate Sci-Fi and crime films higher and more frequently than women. Women and men both give action films an almost equal rating, but men rate these films more frequently.
Table 10: Gender-based statistics of movie genres in MovieLens data.
Following Kouki et al. [18], we extract features that combines multiple different sources of information, including similarity between pairs of users (userPearsonSim()), similarity between items (itemPearsonSim(
)), average rating with respect to users and
Table 12: Mean square errors (MSE) results on state-of-the-art fairness models and Fair-A3SL on MovieLens dataset
Table 13: Overall fairness measurements of state-of-the-art fairness models and Fair-A3SL on MovieLens dataset
items to serve as priors (avgUserRating(U) and avgItemRating(I)), and leveraging predictions from existing recommendation algorithms as a feature (rating) to enable an appropriate comparison. Table 11 gives the rules learned by Fair-A3SL.
We compare our approach to the state-of-the-art recommender systems baseline models: i) HyPER [18], which is a PSL model and includes hybrid recommender systems feature,; ii) matrix factorization based collaborative filtering model [17], iii) Fair-HyPER [11], which defines additional latent variable rules to abstract the rating of unprotected and protected groups in order to ensure there is no overestimation unfairness, iv) baseline model Fair-MF [23], which considers overestimation and non-parity unfairness as regularization terms. Table 12 shows Fair-A3SL achieves the best overall performance for both the protected and unprotected groups. Table 13 shows that our Fair-A3SL model gets a comparable value in the overestimation unfairness measure, and the best value in the non-parity fairness measure. The model learned by Fair-A3SL achieves comparable performance to Fair-HyPER even without the inclusion of carefully designed latent variables that provide additional complexity.
In this work, we developed Fair-A3SL, a general purpose fair structure learning algorithm for HL-MRFs and demonstrated that it learns fair, semantically interpretable, and expressive relational structures while achieving good prediction performance. Fair-A3SL is capable of encoding various different measures of fairness both as constraints and priors and we demonstrate its effectiveness across three different domains and modeling scenarios. Further, Fair-A3SL has minimal pre-processing requirements (only those posed by the underlying fairness measures) and can seamlessly be utilized to learn models for any sensitive prediction problem including those that require complex relational structures. Fair-A3SL’s joint qualities of fairness, interpretability, and performance make it lucrative for many downstream applications (e.g., bank loans, student admissions) to adopt it.
[1] IBM AI fairness 360 open source toolkit. https://aif360. mybluemix.net/.
[2] Stephen H Bach, Matthias Broecheler, Bert Huang, and Lise Getoor, ‘Hinge-loss markov random fields and probabilistic soft logic’, Journal of Machine Learning Research (JMLR), 18(109), 1–67, (2017).
[3] Solon Barocas and Andrew D Selbst, ‘Big data’s disparate impact’, California Law Review, 104, 671, (2016).
[4] Danah Boyd, Karen Levy, and Alice Marwick, ‘The networked nature of algorithmic discrimination’, Data and Discrimination: Collected Essays. Open Technology Institute, (2014).
[5] Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein, et al., ‘Distributed optimization and statistical learning via the alternating direction method of multipliers’, Foundations and Trends Rin Machine learning, 1–122, (2011).
[6] Flavio Calmon, Dennis Wei, Bhanukiran Vinzamuri, Karthikeyan Natesan Ramamurthy, and Kush R Varshney, ‘Optimized pre-processing for discrimination prevention’, in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS), (2017).
[7] L Elisa Celis, Lingxiao Huang, Vijay Keswani, and Nisheeth K Vishnoi, ‘Classification with fairness constraints: A meta-algorithm with provable guarantees’, in Proceedings of the Conference on Fairness, Accountability, and Transparency (FAT*), (2019).
[8] Michele Donini, Luca Oneto, Shai Ben-David, John S Shawe-Taylor, and Massimiliano Pontil, ‘Empirical risk minimization under fairness constraints’, in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS), (2018).
[9] Julia Dressel and Hany Farid, ‘The accuracy, fairness, and limits of predicting recidivism’, Science advances, 4(1), eaao5580, (2018).
[10] Golnoosh Farnadi, Behrouz Babaki, and Lise Getoor, ‘Fairness in relational domains’, in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (AIES), (2018).
[11] Golnoosh Farnadi, Pigi Kouki, Spencer K Thompson, Sriram Srinivasan, and Lise Getoor, ‘A fairness-aware hybrid recommender system’, in RecSys Workshop on FATREC, (2018).
[12] Michael Feldman, Sorelle A Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkatasubramanian, ‘Certifying and removing disparate impact’, in Proceedings of the International Conference on Knowledge Discovery and Data Mining (KDD), (2015).
[13] Moritz Hardt, Eric Price, Nati Srebro, et al., ‘Equality of opportunity in supervised learning’, in Proceedings of the Conference on Advances in neural information processing systems (NIPS), (2016).
[14] Faisal Kamiran and Toon Calders, ‘Data preprocessing techniques for classification without discrimination’, Knowledge and Information Systems (KAIS), 1–33, (2012).
[15] Faisal Kamiran, Asim Karim, and Xiangliang Zhang, ‘Decision theory for discrimination-aware classification’, in Proceedings of the International Conference on Data Mining (ICDM), (2012).
[16] Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, and Jun Sakuma, ‘Fairness-aware classifier with prejudice remover regularizer’, in Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, (2012).
[17] Yehuda Koren, Robert Bell, and Chris Volinsky, ‘Matrix factorization techniques for recommender systems’, Computer, (8), 30–37, (2009).
[18] Pigi Kouki, Shobeir Fakhraei, James Foulds, Magdalini Eirinaki, and Lise Getoor, ‘Hyper: A flexible and extensible probabilistic framework for hybrid recommender systems’, in Proceedings of the ACM Conference on Recommender Systems (RecSys), (2015).
[19] Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin, ‘How we analyzed the COMPAS recidivism algorithm’, in ProPublica, (2016).
[20] Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray
Kavukcuoglu, ‘Asynchronous methods for deep reinforcement learning’, in Proceedings of the International Conference on Machine Learning (ICML), (2016).
[21] Dino Pedreschi, Salvatore Ruggieri, and Franco Turini, ‘A study of top-k measures for discrimination discovery’, in Proceedings of the Annual ACM Symposium on Applied Computing, (2012).
[22] Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian Q Weinberger, ‘On fairness and calibration’, in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS), (2017).
[23] Sirui Yao and Bert Huang, ‘Beyond parity: Fairness objectives for collaborative filtering’, in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS), (2017).
[24] Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork, ‘Learning fair representations’, in Proceedings of the International Conference on Machine Learning (ICML), (2013).
[25] Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell, ‘Mitigating unwanted biases with adversarial learning’, in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (AIES), (2018).
[26] Yue Zhang and Arti Ramesh, ‘Learning interpretable relational structures of hinge-loss markov random fields’, in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), (2019).