Aspects of reparametrization in Gaussian process regression with the Weibull model.

Show simple item record

dc.contributor Helsingin yliopisto, Matemaattis-luonnontieteellinen tiedekunta fi
dc.contributor University of Helsinki, Faculty of Science en
dc.contributor Helsingfors universitet, Matematisk-naturvetenskapliga fakulteten sv
dc.contributor.author Tanskanen, Ville
dc.date.issued 2018
dc.identifier.uri URN:NBN:fi:hulib-202002251403
dc.identifier.uri http://hdl.handle.net/10138/312288
dc.description.abstract Gaussian processes can be used through Bayesian models so that they are formed through a multidimensional Gaussian prior with a special covariance matrix structure and an arbitrary likelihood model. They often include a latent variable structure between the features and the response variable. Bayesian modeling's drawbacks are usually related to the normalizing constants that normalize the product of a prior probability density function and a likelihood function to a proper probability distribution. These integrals are hard or even impossible to calculate analytically and hence some approximations are required. One popular approximation is the Laplace approximation, which is a Gaussian approximation for the unnormalized log-posterior distribution. Reparametrization of the observation model can lead to changes in properties of the posterior distribution such as shape and convergence. The performance of approximations made for the posterior distribution also change along with the parametrization. The changes are often related to either computational complexity or the predictive performance of the approximation. This thesis presents the Gaussian processes starting from Bayes' formula and moves quickly towards key concepts in Bayesian modeling such as predictive distributions and hierarchy. An approximation of interest for the posterior distribution, the Laplace approximation, is derived. Traditional optimization algorithm for the Laplace approximation is the Newton method, which is replaced by an algorithm called natural gradient adaptation in this thesis. Then the focus is turned from general introduction of Gaussian processes to more specific treatment of them by choosing the Weibull distribution as an observation model. Two different parametrizations for the Weibull model are studied, one which acts as a baseline and can be thought as traditional parametrization for the model, and another one for which the parameters are orthogonal. The predictive performance of the Laplace approximation is then compared within the two parametrizations in two different kind of data sets. Finally the results show decrease in computation time required for the Laplace approximation but no improvement in the predictive performance for orthogonal parametrization. en
dc.language.iso eng
dc.publisher Helsingin yliopisto fi
dc.publisher University of Helsinki en
dc.publisher Helsingfors universitet sv
dc.title Aspects of reparametrization in Gaussian process regression with the Weibull model. en
dc.type.ontasot pro gradu -tutkielmat fi
dc.type.ontasot master's thesis en
dc.type.ontasot pro gradu-avhandlingar sv
dc.subject.discipline Soveltava matematiikka und
dct.identifier.urn URN:NBN:fi:hulib-202002251403

Files in this item

Total number of downloads: Loading...

Files Size Format View
VilleTanskanenGradu.pdf 956.4Kb PDF View/Open

This item appears in the following Collection(s)

Show simple item record