Altmetric

Optimisation strategies for ensuring fairness in machine learning: with and without demographics

File Description SizeFormat 
Zhou-Q-2024-PhD-Thesis.pdfThesis2.44 MBAdobe PDFView/Open
Title: Optimisation strategies for ensuring fairness in machine learning: with and without demographics
Authors: Zhou, Quan
Item Type: Thesis or dissertation
Abstract: Ensuring fairness has emerged as one of the primary concerns in Artificial Intelligenc (AI) and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field and introduces two formal frameworks to tackle open questions in machine learning fairness. In one framework, operator-valued optimisation and min-max objectives are employed to address unfairness in time-series problems. This approach showcases state-of-the-art performance on the notorious Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) benchmark dataset, demonstrating its effectiveness in real-world scenarios. In the second framework, the challenge of lacking sensitive attributes, such as gender and race, in commonly used datasets is addressed. This issue is particularly pressing because existing algorithms in this field predominantly rely on the availability or estimations of such attributes to assess and mitigate unfairness. Here, a framework for a group-blind bias-repair is introduced, aiming to mitigate bias without relying on sensitive attributes. The efficacy of this approach is showcased through analyses conducted on the Adult Census Income dataset. Additionally, detailed algorithmic analyses for both frameworks are provided, accompanied by convergence guarantees, ensuring the robustness and reliability of the proposed methodologies.
Content Version: Open Access
Issue Date: Mar-2024
Date Awarded: Aug-2024
URI: http://hdl.handle.net/10044/1/114540
DOI: https://doi.org/10.25560/114540
Copyright Statement: Creative Commons Attribution NonCommercial Licence
Supervisor: Shorten, Robert
Marecek, Jakub
Sponsor/Funder: European Union
Innovate UK
Science Foundation Ireland
Funder's Grant Number: Grant agreement No. 101070568
UKRI Reference Number: 10040569 (Human-Compatible Artificial Intelligence with Guarantees (AutoFair))
Grant 16/IA/4610
Department: Dyson School of Design Engineering
Publisher: Imperial College London
Qualification Level: Doctoral
Qualification Name: Doctor of Philosophy (PhD)
Appears in Collections:Design Engineering PhD theses



This item is licensed under a Creative Commons License Creative Commons