This project started out as an attempt the replicate the experiment of Lagazio and Marwala with additional economic data about countries.  A significant amount of time was put into finding the data Lagazio and Marwala used as well as finding economic data.  While I did eventually manage to find a data set similar to the one used by Lagazio and Marwala, it used a numerical identification system for countries that made it impossible to relate the data to any other dataset.

 

In the process of failing to replicate the Lagazio and Marwala experiment I did come across the fantastically useful Matlab library NETLAB.  This library had Bayesian neural networks and ARD already implemented.  After giving up on replicating the Lagazion and Marwala experiment I spent some time playing around with this and trying to characterize of ARD.  These results were incredibly boring: as far as I could tell ARD works exactly as described.  I regret that I did not meticulously document these results, as I would have liked to include them in this report, but I seem to have lost them in Matlab.

 

Ultimately I became interested in the theory behind ARD.  I choose to write a paper on ARD to further my understanding of the subject.  The resulting paper is, in my opinion, not as good as it should be.  I knowing left key parts of the ARD algorithm (specifically the evidence function, a better explanation of how priors work, and results) and the prose leaves something to be desired.  These faults are mostly due to a lack of time, a result of poor estimation and planning on my part,  Despite these failures I do think that I learned quite a bit from this project- a rough introduction to Bayesian learning, a different way of thinking about neural nets, the problems with arbitrary data, why its important to stick to your topic, etc...

 

I hope this explanation helps you better understand my project.  Thank you very much.