國立高雄大學圖資館 |

Language: English

Back

Analysis of big data by split-and-co...

Chen, Xueying.

Analysis of big data by split-and-conquer and penalized regressions: New methods and theories.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Analysis of big data by split-and-conquer and penalized regressions: New methods and theories.
Author:	Chen, Xueying.
Description:	129 p.
Notes:	Source: Dissertation Abstracts International, Volume: 74-08(E), Section: B.
Notes:	Advisers: Minge Xie; Cun-Hui Zhang.
Contained By:	Dissertation Abstracts International74-08B(E).
Subject:	Biology, Biostatistics.
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3558683
ISBN:	9781303031960

Analysis of big data by split-and-conquer and penalized regressions: New methods and theories.
Chen, Xueying.

Analysis of big data by split-and-conquer and penalized regressions: New methods and theories. - 129 p.

Source: Dissertation Abstracts International, Volume: 74-08(E), Section: B.

Thesis (Ph.D.)--Rutgers The State University of New Jersey - New Brunswick, 2013.

This dissertation develops methodologies for analysis of big data and its related theoretical properties. Recent years, tremendous progress has been made in analysis of big data, especially techniques via penalization and shrinkages. However, there are still many challenging problems to be solved. This dissertation focuses on two settings where (i) the data is too large to fit into a single computer or too expensive to perform a computationally intensive data analysis; or (ii) there are unknown group structures of highly correlated variables. In this dissertation, we first propose a Split-and-Conquer approach to analyze extraordinarily large data. Then, under linear regression settings with highly correlated variables, we investigate model selection properties of OSCAR (octagonal shrinkage and clustering algorithm for regression) estimators (Bondell & Reich, 2008) and propose a more general method Group OSCAR which incorporates both prior knowledge of group structures and correlation patterns among explanatory variables.

ISBN: 9781303031960Subjects--Topical Terms:

227395
Biology, Biostatistics.

Analysis of big data by split-and-conquer and penalized regressions: New methods and theories.
LDR:03375nmm a2200313 4500 001 419254
005 20140520124006.5
008 140717s2013 ||||||||||||||||| ||eng d
020 $a 9781303031960
035 $a (MiAaPQ)AAI3558683
035 $a AAI3558683
040 $a MiAaPQ $c MiAaPQ
100 1 $a Chen, Xueying. $3 660268
245 1 0 $a Analysis of big data by split-and-conquer and penalized regressions: New methods and theories.
300 $a 129 p.
500 $a Source: Dissertation Abstracts International, Volume: 74-08(E), Section: B.
500 $a Advisers: Minge Xie; Cun-Hui Zhang.
502 $a Thesis (Ph.D.)--Rutgers The State University of New Jersey - New Brunswick, 2013.
520 $a This dissertation develops methodologies for analysis of big data and its related theoretical properties. Recent years, tremendous progress has been made in analysis of big data, especially techniques via penalization and shrinkages. However, there are still many challenging problems to be solved. This dissertation focuses on two settings where (i) the data is too large to fit into a single computer or too expensive to perform a computationally intensive data analysis; or (ii) there are unknown group structures of highly correlated variables. In this dissertation, we first propose a Split-and-Conquer approach to analyze extraordinarily large data. Then, under linear regression settings with highly correlated variables, we investigate model selection properties of OSCAR (octagonal shrinkage and clustering algorithm for regression) estimators (Bondell & Reich, 2008) and propose a more general method Group OSCAR which incorporates both prior knowledge of group structures and correlation patterns among explanatory variables.
520 $a We first propose a split-and-conquer approach and illustrate it using a computationally intensive penalized regression method. We show that the combined result is asymptotically equivalent to the corresponding analysis result of using the entire data all together. In addition, we demonstrate that the approach has an inherent advantage of being more resistant to false model selections. Furthermore, when a computational intensive algorithm is used, we show that the split-and-conquer approach can substantially reduce computing time and computer memory requirement.
520 $a Detecting meaningful 'groups' of highly correlated variables has been studied a lot. OSCAR estimators provide a feasible way to perform variable selection and clustering simultaneously. However, no theoretical results are provided for OSCAR estimators. In this dissertation, we provide a set of mild conditions under which OSCAR estimators are able to select the true model and keep the order of the coefficients by their magnitudes when the correlations are high.
520 $a In the last part of this dissertation, we propose a new method. This method not only takes use of known group structures but also incorporates the correlation patterns leading to the underlying unknown group structure. It extends most of the model selections methods in the literature, and has a general grouping effect.
590 $a School code: 0190.
650 4 $a Biology, Biostatistics. $3 227395
650 4 $a Statistics. $3 182057
690 $a 0308
690 $a 0463
710 2 $a Rutgers The State University of New Jersey - New Brunswick. $b Statistics and Biostatistics. $3 660269
773 0 $t Dissertation Abstracts International $g 74-08B(E).
790 $a 0190
791 $a Ph.D.
792 $a 2013
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3558683

based on 0 review(s)

Multimedia

Multimedia file
http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3558683

Reviews

Add a review and share your thoughts with other readers

Export

pickup library