Change search
ReferencesLink to record
Permanent link

Direct link
Parallel Multiple Proposal MCMC Algorithms
Norwegian University of Science and Technology, Faculty of Information Technology, Mathematics and Electrical Engineering, Department of Mathematical Sciences.
2007 (English)MasteroppgaveStudent thesis
Abstract [en]
We explore the variance reduction achievable through parallel implementation of multi-proposal MCMC algorithms and use of control variates. Implemented sequentially multi-proposal MCMC algorithms are of limited value, but they are very well suited for parallelization. Further, discarding the rejected states in an MCMC sampler can intuitively be interpreted as a waste of information. This becomes even more true for a multi-proposal algorithm where we discard several states in each iteration. By creating an alternative estimator consisting of a linear combination of the traditional sample mean and zero mean random variables called control variates we can improve on the traditional estimator. We present a setting for the multi-proposal MCMC algorithm and study it in two examples. The first example considers sampling from a simple Gaussian distribution, while for the second we design the framework for a multi-proposal mode jumping algorithm for sampling from a distribution with several separated modes. We find that the variance reduction achieved from our control variate estimator in general increases as the number of proposals in our sampler increase. For our Gaussian example we find that the benefit from parallelization is small, and that little is gained from increasing the number of proposals. The mode jumping example however is very well suited for parallelization and we get a relative variance reduction pr time of roughly 80% with 16 proposals in each iteration.
Place, publisher, year, edition, pages
Institutt for matematiske fag , 2007. , 40 p.
Keyword [no]
ntnudaim:3425, SIF3 fysikk og matematikk, Industriell matematikk
URN: urn:nbn:no:ntnu:diva-12857Local ID: ntnudaim:3425OAI: diva2:426895
Available from: 2011-06-27 Created: 2011-06-27

Open Access in DiVA

fulltext(576 kB)884 downloads
File information
File name FULLTEXT01.pdfFile size 576 kBChecksum SHA-512
Type fulltextMimetype application/pdf
cover(48 kB)23 downloads
File information
File name COVER01.pdfFile size 48 kBChecksum SHA-512
Type coverMimetype application/pdf

By organisation
Department of Mathematical Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 884 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 63 hits
ReferencesLink to record
Permanent link

Direct link