Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/91230
Title: | An evaluation of Ridge regression as a possible solution to multicollinearity problems |
Authors: | Darmanin, Roberta (2011) |
Keywords: | Regression analysis Multicollinearity Ridge regression (Statistics) |
Issue Date: | 2011 |
Citation: | Darmanin, R. (2011). An evaluation of Ridge regression as a possible solution to multicollinearity problems (Bachelor's dissertation). |
Abstract: | The most popular regression technique used to estimate regression coefficients is the Ordinary Least Squares (OLS} method. However, in cases when multicollinearity is present, the Ordinary Least Squares is said to perform badly and is often characterised by instabilities. In this dissertation, multicollinearity and a number of diagnostics for identifying its presence and its degree are examined. An alternative method to the OLS which is suggested in literature, namely the Ridge Regression technique, is studied. Its performance will be compared to that of the Ordinary Least Squares, in cases of linear dependencies. Three datasets obtained from online data libraries will are analysed. Firstly, the degree of multicollinearity present in each dataset is investigated. Both Ordinary Least Squares and Ridge Regression methods are fit to each dataset, and comparisons are carried out in order to choose the best regression method for each dataset, using established criteria. Weakness of the Ridge Regression technique are identified and discussed. Although Ridge Regression offers a better interpretation of the parameter estimates and reduces the Mean Square Error in the presence of multicollinearity, the estimation of the ridge parameter estimate is very subjective, which makes this technique somewhat an inefficient regression method. |
Description: | B.SC.(HONS)STATS.&OP.RESEARCH |
URI: | https://www.um.edu.mt/library/oar/handle/123456789/91230 |
Appears in Collections: | Dissertations - FacSci - 1965-2014 Dissertations - FacSciSOR - 2000-2014 |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
B.SC.(HONS)STATISTICS_Darmanin_Roberta_2011.pdf Restricted Access | 12.74 MB | Adobe PDF | View/Open Request a copy |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.