國立高雄大學圖資館 |

An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning /

Record Type:	Electronic resources : Monograph/item
Title/Author:	An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning /Subha Maity.
Author:	Maity, Subha,
Description:	1 electronic resource (246 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
Notes:	Advisors: Banerjee, Moulinath Committee members: Sun, Yuekai; Scott, Clayton; Ritov, Yaacov.
Contained By:	Dissertations Abstracts International86-03B.
Subject:	Statistics.
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31631371
ISBN:	9798384043560

An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning /
Maity, Subha,

An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning /Subha Maity. - 1 electronic resource (246 pages)

Source: Dissertations Abstracts International, Volume: 86-03, Section: B.

The main goal of transfer learning strategies is to enhance the efficiency of learning models applied to target tasks by transferring knowledge from similar, yet distinct, source tasks. These strategies are particularly useful when it is excessively costly or impractical to collect an ample volume of training data in the target domain, because by borrowing strength from the source, they can significantly reduce the sample requirement in the target. This has led transfer learning to be widely applied across problems from numerous fields whenever sufficient task-specific data are difficult to obtain, and has allowed its emergence as a popular and promising area of research over the last decade. In contrast to the extensive body of existing literature, which focuses primarily on the development and assessment of various algorithms, the first part of this dissertation adopts a rigorous statistical approach to address and understand certain challenges within the realm of transfer learning, while the latter part explores distribution shift models, which lie at the heart of transfer learning, as sources of bias in machine learning algorithms and their potential impacts on algorithmic fairness. The dissertation begins with an introductory overview of the transfer learning concepts in the first chapter. In the second chapter, it delves into the theoretical limitations of the 'label shift' problem within the framework of nonparametric classification by examining the 'minimax' performance outcomes in classification tasks and highlights the inherent challenges therein related to various problem-specific parameters. The third chapter introduces a simple, yet flexible, linear adjustment model and method that addresses the 'posterior drift' issue when a modest volume of labeled data are accessible from the target domain. This chapter not only undertakes a 'minimax' analysis for the model, but also illustrates a real data application: predicting mortality amongst a minority demographic within the 'UKBiobank' dataset. The fourth chapter proposes an exponential tilt-based statistical framework tailored for classification problems in transfer learning contexts, where, in contrast to the previous chapter, the labeled examples are not present in the target domain, a situation that is significantly challenging in the presence of 'posterior drift'. Along with presenting an importance-weighting approach, this chapter demonstrates the method's effectiveness both from a theoretical standpoint and empirically, through its application to the 'Waterbirds' and 'Breeds' image datasets. The latter half of the thesis posits that biases in machine learning algorithms arise from a 'subpopulation shift' model, which is a standard way to characterize the underrepresentation of minority groups, and examines its impact on various issues related to algorithmic fairness. For such biases, the fifth chapter explores whether the application of standard 'group fairness' tools during the training phase enhances the trained model's performance on a 'target domain', and provides a related necessary and sufficient condition. The final chapter studies how underrepresentation affects the performance of minority groups in a class of representation learning algorithms known as 'contrastive learning'. It reveals that the representations of minority groups tend to collapse with certain majority groups, an issue referred to as 'representation harm' or 'stereotyping', and goes on to show that this representation harm can have detrimental effects on subsequent predictive tasks.

English

ISBN: 9798384043560Subjects--Topical Terms:

182057
Statistics.
Subjects--Index Terms:

Distribution shift

An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning /
LDR:05126nmm a22004453i 4500 001 676397
005 20250420214358.5
006 m o d
007 cr|nu||||||||
008 250901s2024 miu||||||m |||||||eng d
020 $a 9798384043560
035 $a (MiAaPQD)AAI31631371
035 $a (MiAaPQD)umichrackham005819
035 $a AAI31631371
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Maity, Subha, $e author. $3 990223
245 1 3 $a An Exploration of the Statistical Challenges and Fairness Implications of Transfer Learning / $c Subha Maity.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (246 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-03, Section: B.
500 $a Advisors: Banerjee, Moulinath Committee members: Sun, Yuekai; Scott, Clayton; Ritov, Yaacov.
502 $b Ph.D. $c University of Michigan $d 2024.
520 $a The main goal of transfer learning strategies is to enhance the efficiency of learning models applied to target tasks by transferring knowledge from similar, yet distinct, source tasks. These strategies are particularly useful when it is excessively costly or impractical to collect an ample volume of training data in the target domain, because by borrowing strength from the source, they can significantly reduce the sample requirement in the target. This has led transfer learning to be widely applied across problems from numerous fields whenever sufficient task-specific data are difficult to obtain, and has allowed its emergence as a popular and promising area of research over the last decade. In contrast to the extensive body of existing literature, which focuses primarily on the development and assessment of various algorithms, the first part of this dissertation adopts a rigorous statistical approach to address and understand certain challenges within the realm of transfer learning, while the latter part explores distribution shift models, which lie at the heart of transfer learning, as sources of bias in machine learning algorithms and their potential impacts on algorithmic fairness. The dissertation begins with an introductory overview of the transfer learning concepts in the first chapter. In the second chapter, it delves into the theoretical limitations of the 'label shift' problem within the framework of nonparametric classification by examining the 'minimax' performance outcomes in classification tasks and highlights the inherent challenges therein related to various problem-specific parameters. The third chapter introduces a simple, yet flexible, linear adjustment model and method that addresses the 'posterior drift' issue when a modest volume of labeled data are accessible from the target domain. This chapter not only undertakes a 'minimax' analysis for the model, but also illustrates a real data application: predicting mortality amongst a minority demographic within the 'UKBiobank' dataset. The fourth chapter proposes an exponential tilt-based statistical framework tailored for classification problems in transfer learning contexts, where, in contrast to the previous chapter, the labeled examples are not present in the target domain, a situation that is significantly challenging in the presence of 'posterior drift'. Along with presenting an importance-weighting approach, this chapter demonstrates the method's effectiveness both from a theoretical standpoint and empirically, through its application to the 'Waterbirds' and 'Breeds' image datasets. The latter half of the thesis posits that biases in machine learning algorithms arise from a 'subpopulation shift' model, which is a standard way to characterize the underrepresentation of minority groups, and examines its impact on various issues related to algorithmic fairness. For such biases, the fifth chapter explores whether the application of standard 'group fairness' tools during the training phase enhances the trained model's performance on a 'target domain', and provides a related necessary and sufficient condition. The final chapter studies how underrepresentation affects the performance of minority groups in a class of representation learning algorithms known as 'contrastive learning'. It reveals that the representations of minority groups tend to collapse with certain majority groups, an issue referred to as 'representation harm' or 'stereotyping', and goes on to show that this representation harm can have detrimental effects on subsequent predictive tasks.
546 $a English
590 $a School code: 0127
650 4 $a Statistics. $3 182057
650 4 $a Computer science. $3 199325
653 $a Distribution shift
653 $a Transfer learning
653 $a Learning models
653 $a Machine learning
653 $a Target domain
690 $a 0463
690 $a 0984
690 $a 0800
710 2 $a University of Michigan. $b Statistics. $e degree granting institution. $3 990224
720 1 $a Banerjee, Moulinath $e degree supervisor.
773 0 $t Dissertations Abstracts International $g 86-03B.
790 $a 0127
791 $a Ph.D.
792 $a 2024
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31631371