HMC CS 152, Fall 2010

Syllabus

Text: Simon Haykin, Neural Networks and Learning Machines, Third Edition, Hardcover: 936 pages, Prentice Hall (November 28, 2008) ISBN-13: 978-0131471399

Student Projects

CAPTCHA Solving with MLP Networks by Sonja Bohr and Daniel Lubarov
Temporal Difference Learning in the Game of Havannah by Jeffrey Burkert
Where's Waldo? Using Neural Nets to Search Images by Becky Green
Controllers with PID and Movitation for Neural Networks by Max Kukartshev
Text Classification of Newsgroup Messages with Neural Networks by Audrey Lawrence and Singer Ma
Exemplar-Based Texture Synthesis Using Restricted Boltzmann Machines by Calvin Loncaric
NBA Game Prediction by Alejandro Lopez-Lago
Online Method for System Identification using Fuzzy Neural Networks by Cullen MacMahon
Parallel Implementation of a Deep Belief Network by Eric Mullen
Long Short-Term Memory by Colin O'Byrne
Learning to Play Pentago Using TD(lambda) by Austin Quan

WiiConduct by Jory Schossau
Applying a Genetic Algorithm to Find the Optimal Weights of a Recurrent Neural Network by Tselil Schramm
Solving 3SAT using Neural Networks by Steven Watanabe

Student Presentations

Traffic Sign Recognition for Intelligent Vehicle/Driver Assistance System by Becky Green
Embodied Biological Neural Networks by Austin Quan
Texture Detection Using Neural Networks Trained on Positive-Only Examples by Calvin Loncaric

Paper Suggestions

Lecture Slides, and Selected Related Material

Assignments

Datasets

Each dataset begins with two numbers, with a space between:

The number of outputs
The number of inputs

following which are the data points, one per line.

File Name	Function	Outputs	Output range	Inputs	Input range	# of Samples	My best	Configuration
xor.in	xor	1	{0, 1}	2	{0, 1}	4	xor.best	xor.rprop.sh
parity6.in	xor	1	{0, 1}	6	{0, 1}	64	parity6.best	parity6.rprop.sh
cancer.in	cancer	1	{0, 1}	9	{0..10}	683	cancer.best	cancer.rprop.sh
binary.in	a single value between 0 to 7 is converted to 3 bits	3	1	{0..7}	8	{0, 1}	binary.best	binary.rprop.sh
letters.in	upper-case letters 7x5 bitmap	26	{0, 1}	35	{0, 1}	26	letters.best	letters.rprop.sh
licks.in	jazz licks 424 bitmap	1	{0..1 in steps of 0.1}	424	{0, 1}	505	licks.best	licks.rprop.sh

Demos

GloveTalk II
Digit Recognition demo (Backpropagation)
LeNet-5, Convolutional Neural Networks (LeCun Demos and Papers)
Nettalk
- Nettalk audio, part 1 (learning demo)
- Nettalk audio, part 2 (after 10,000 training words)
- Nettalk audio, part 3 (testing on non-training data)
- Senjowski Nettalk Corpus
Learning Mouse Gestures
3D Object Recognition demo (Radial Basis Functions)
Pole Balancer using SANE demo (Jeff Lawson, HMC)
GNG Demo (Growing Neural Gas)
SOM Number Recognition Demo
Graphic TSP Demo using Genetic Algorithm

Various References

Neural Networks Wikipedia Index
Matlab NN Toolbox
Tutorial on Matlab NN Toolbox (Tech. U. Graz)
Neural Nets FAQ
Fundamentals of Artificial Neural Networks, by Mohamad H. Hassoun, MIT Press, 1995 (HTML version)
Slides from Tom Mitchell's Machine Learning Book
Neural Nets Applications (16 of them)
Neural Nets Applications (Commercial, Brainmaker)
Neural Nets Applications (Commercial, Alyuda)
Spiking Neuron Models
Gradient Descent (wikipedia)
Adaline slides from NND
Adaptive Filter (wikipedia)
LMS Filter (wikipedia)
RLS Filter (wikipedia)
Backpropagation
- Backprop slides from NND
- Six Lectures on Backpropagation (Leslie Smith)
- Note on Levenberg-Marquardt Optimization by Sam Rowels
- Backpropagator's Review (Donald Tveter)
- The Pattern Recognition Basis of Artificial Intelligence (Donald Tveter)
  - Coding Data for Character Recognition
- Methods to Speed Up Backpropagation (Dilip Sarkar, ACM Computing Surveys)
- Optimization with Numerical Methods
- LeNet-5, Convolutional Neural Networks (LeCun Demos and Papers)
- NetTalk (Senjowski and Rosenberg, Dataset)
- Multivariate chain rule
- Fahlman's Quickprop paper (in CiteSeer)
- Rprop (wikipedia)
- A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm (1993)
- Advanced Supervised Learning in Multi-layer Perceptrons - From Backpropagation to Adaptive Learning Algorithms (1994)
- Short description of Rprop (Resilient Backpropagation, from SNNS)
- Original Rprop paper (Riedmiller and Braun, in CiteSeer)
- Rprop Implementation Details
- Empirical evaluation of the improved Rprop learning algorithm (Igel, et al., 2003)
- Sarprop paper (Treadgold and Gedeon, in CiteSeer)
- Neural Networks for Face Recognition
Radial Basis Functions
- Improving the Performance of K-Means Clustering Algorithm to Position the Centres of RBF Network
- 3D Object Recognition demo
Moore-Penrose Pseudo-Inverse
Linear Regression
Time-Based Approaches and Applications
- Time Series Forecasting
- Guide to recurrent neural networks and backpropagation
- Truck-Backer paper (Widrow and Nguyen, IEEE Xplore)
  - Truck backer using Genetic Programming
- Backpropagation Through Time (BPTT, Werbos article)
- Applying BPTT to Inverted Pendulum
- BPTT paper (Jesus and Hagan, with pseudo-code)
- Werbos presentation on Control Theory and Related Techniques (1988)
- BPTT and DAC (Derivative Adaptive Critic)
- Arabic speech recognition article (BPTT application)
- Adaptive Heuristic Critic (based on TD)
- Black Jack and Reinforcement Learning
- Temporal difference learning (Barto, scholarpedia)
- Reinforcement learning (Woergoetter Porr, scholarpedia)
- Reinforcement Learning: An Introduction (Sutton and Barto)
Game-Playing
- NeuroGo
- Chess End-Games
- Trained Neural Networks Play Chess End Games
- Tic-Tac-Toe example
- Blackjack Applet
Radial Basis Functions (RBFs)
- Brief Description (SNNS)
- Example code (matlab)
- Learning rules (SNNS)
- FastRBF Toolbox (Commercial, FarField Technology)
Function Minimization GA Demo
Examples of function minimization
GAs for NNs
k-Means Clustering
- Demo, with Voronoi regions
Self-Organizing Maps
- Kohonen Network (Scholarpedia article)
- SOM demos (1D and 2D)
- 3D Map demo (TSP, Jochen Froehlich)
- Some Competitive Learning Methods (Bernd Fritzke)
- Bayesian SOM demo
- Data exploration using self-organizing maps
- GHSOM Toolbox
- SOM_PAK toolkit
- Convergence Rate in Intelligent Self-organizing Feature Map Using Dynamic Gaussian Function
ART Networks
Adaptive Resonance Theory (wikipedia)
Hopfield Nets
- Hopfield's original paper
- Hopfield Network (scholarpedia, by John Hopfield)
- Hopfield net (wikipedia)
- Attractor Networks (scholarpedia, by Chris Eliasmith)
- Energy Surface
- Notes on Associative, Hopfield, and BAM Networks
- Hopfield net demo (Heaton Research)
- Bit-map Hopfield demo Hopfield Demo showing iterations (Pong, shows updating)
- Another Hopfield demo
- Hopfield demo, with pattern overlap indicator
- Hopfield and BAM demos (Java failure?)
- Hopfield TSP demo
Boltzmann Machines
- Boltzmann machine (wikipedia)
- Boltzmann Machine (scholarpedia, by Geoffrey Hinton)
- Reducing the Dimensionality of Data with Neural Networks (G. E. Hinton and R. R. Salakhutdinov)
- TSP via Simulated Annealing
- Ising Model Applet
- Another Ising Model
- Yet Another Ising Model
- The Next Generation of Neural Networks
- Restricted Boltzmann Machines for Collaborative Filtering
- Machine Learning with PLearn
PCA, ICA, etc.
- PCA (Wikipedia article)
- PCA demos
- Oja Learning Rule (Scholarpedia article)
- GHA (Generalized Hebbian Algorithm, aka Sanger's Rule)
- FERET Photobook
- Eigenface Tutorial
- ICA Tutorial
- ICA introduction
- Cocktail Party Problem (Helsinki University)
- Blind source separation (
- Fast ICA Package
- ICA Survey paper
- ICA Links (Tony Bell)
SVM (Support Vector Machines)
- kernel-machines.org tutorials
- wikipedia article
- SVM demo (AT&T)
- libsvm (includes demo)
- Version Space applet (G. Gordon)
- List of other software
- SVM Tool (tagging parts of speech)
- Matlab SVM Toolbox
- support-vector-machines.org
- Lagrange Multiplier Applet
- Kernel PCS
Fuzzy Logic slides
Fuzzy Logic (wikipedia)
Evolutionary Computation (slides)
- Evolving Neural Controllers (Brandeis)
- Genetic Algorithms (wikipedia)
- Genetic Route Planner demo
- Memetic Algorithms (wikipedia)
- Genetic Programming (wikipedia)
- Pagentree
- Functional genetic programming with combinators (Briggs and O'Neill)
- Field Guide to GP Artificial Life (wikipedia)
- GenePooL
- Flies
- Driving GA
- Zooland (links)
Statistical Pattern Recognition Tool (SVM, PCA, ...)
Information Retrieval (applies SVM's, etc.)
Data Mining Software Links
Sebastian Seung's Course
Retina, LGN
Visual Cortex
BCM Theory

Miscellaneous
- Hebbian Learning (Wikipedia article)
- Anti-Hebbian Learning (Wikipedia article)
- UCI Machine Learning Repository
- Self-erecting inverted pendulum
- Self-erecting inverted pendulum
- Double inverted pendulum
- Inverted Pendulum control equations
- Inverted pendulum on a toy car (student project)
- Emergent (rewrite of PDP++)
- Face Recognition Homepage
- The Talented Dr. Hebb, Part 1 - Novelty Filtering
- Classifier Showdown (Peltarion)
- Various Tutorials (Peltarion)
Lists of Links
- Applets
- Software and Datasets