Altmetric
Optimisation strategies for ensuring fairness in machine learning: with and without demographics
File | Description | Size | Format | |
---|---|---|---|---|
Zhou-Q-2024-PhD-Thesis.pdf | Thesis | 2.44 MB | Adobe PDF | View/Open |
Title: | Optimisation strategies for ensuring fairness in machine learning: with and without demographics |
Authors: | Zhou, Quan |
Item Type: | Thesis or dissertation |
Abstract: | Ensuring fairness has emerged as one of the primary concerns in Artificial Intelligenc (AI) and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field and introduces two formal frameworks to tackle open questions in machine learning fairness. In one framework, operator-valued optimisation and min-max objectives are employed to address unfairness in time-series problems. This approach showcases state-of-the-art performance on the notorious Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) benchmark dataset, demonstrating its effectiveness in real-world scenarios. In the second framework, the challenge of lacking sensitive attributes, such as gender and race, in commonly used datasets is addressed. This issue is particularly pressing because existing algorithms in this field predominantly rely on the availability or estimations of such attributes to assess and mitigate unfairness. Here, a framework for a group-blind bias-repair is introduced, aiming to mitigate bias without relying on sensitive attributes. The efficacy of this approach is showcased through analyses conducted on the Adult Census Income dataset. Additionally, detailed algorithmic analyses for both frameworks are provided, accompanied by convergence guarantees, ensuring the robustness and reliability of the proposed methodologies. |
Content Version: | Open Access |
Issue Date: | Mar-2024 |
Date Awarded: | Aug-2024 |
URI: | http://hdl.handle.net/10044/1/114540 |
DOI: | https://doi.org/10.25560/114540 |
Copyright Statement: | Creative Commons Attribution NonCommercial Licence |
Supervisor: | Shorten, Robert Marecek, Jakub |
Sponsor/Funder: | European Union Innovate UK Science Foundation Ireland |
Funder's Grant Number: | Grant agreement No. 101070568 UKRI Reference Number: 10040569 (Human-Compatible Artificial Intelligence with Guarantees (AutoFair)) Grant 16/IA/4610 |
Department: | Dyson School of Design Engineering |
Publisher: | Imperial College London |
Qualification Level: | Doctoral |
Qualification Name: | Doctor of Philosophy (PhD) |
Appears in Collections: | Design Engineering PhD theses |
This item is licensed under a Creative Commons License