CS 152 Reference Links

Under Reconstruction

• Demos
  • Hopfield Net Pattern recall demo (10x10)
  • Hopfield Net Demo(4x4 and 10x10)
  • J.O.H.N. Hopfield Net (15x15) (documentation)
  • Hopfield Net (4 neuron)
  • Boltzmann Necker Cube
  • Truck-Backer using Genetic Programming
  • TSP using Hopfield Net
  • Fuzzy Controller for Ship Load Sway
  • Fuzzy Shower demo

• Short Tutorials
  • +++ Birth of a Learning Law (Stephen Grossberg)
  • +++ Artificial Neural Networks (Diane Cook)
  • +++ An Introduction to Neural Networks (Leslie Smith)
  • +++ Mind and Machine (Syracuse University)
  • +++ Character Recognition
  • +++ Artificial Neural Networks Technology (DoD DAC)
  • +++ Hopfield Netowkrs (Terry Regier)
  • +++ Generalization in feedforward classifiers

• Surveys
  • +++ Neural Nets (Kevin Gurney)
  • Probabilistic Models for Unsupervised Learning (pdf)
  • Information Theory, Pattern Recognition and Neural Networks (David McKay)
  • Machine Learning, Neural and Statistical Classification (D. Michie, D.J. Spiegelhalter, C.C. Taylor, eds.)
  • Soft-Computing Guidebook (National University of Singapore)

• FAQs
  • comp.ai.neural-nets
  • Bayesian methods
  • Data Analysis
  • Fuzzy Logic

• Math
  • Data Analysis BriefBook

• Lecture Notes
  • Introduction to Neural Networks (Nici Schraudolph and Fred Cummins)
  • Basics of Neural Networks
  • Datamining and Machine Learning

• Applications
  • NetTalk
  • Accelerate Testing of Mechanical Systems
  • Magnetically Suspended Rotor System
  • Control of Springback and Strain
  • Reduction of Greenhouse Gases
  • Adaptive Non-Linear Flight Control
  • Adaptive control of heating processes
  • Novel Neural Network Control Techniques for Industrial Motion Control Systems
  • Neural Network Control in the Metals Industry
  • Unmanned Air Vehicle
  • ALVINN (Autonomous Land Vehicle)
  • Forecasting applications (ESPRIT-II Project No. 5433)
  • GloveTalk II
  • NeuroSolutions Applications Corner (NeuroDimension Inc.)
  • Pyrolysis Mass Spectrometry (University of Wales)
  • RBF applied to Color Image Classification
  • Financial Forecasting in Financial Markets (commercial)
  • Information Retrieval
  • Inverse Protein Folding (Thomas Fink thesis)
  • The Science of Audio Based Brainwave Entrainment
  • Neurocomputing in Geography
  • A Comparison of Classification in Artificial Intelligence, Induction versus Neural Networks

• Associative Networks
  • Auto-Associative Networks
  • Automatic Subject Indexing using Associative Networks

• Backpropagation
  • Backpropagator's Review (Donald Tveter)
  • Function approximation
  • Multi-layer Perceptron Applet
  • What Size Neural Network Gives Optimal Generalization? Convergence Properties of Backpropagation
  • XOR Backprop

• Recurrent Networks
  • Bibliography (Lee Giles)
  • Elman Networks
  • Phoneme Recognition
  • Recurrent Nets and Motor Learning
  • Synthesis of Cascade Recurrent Neural Networks Using Feedforward Generalization Properties
  • Barry Kalman's home page
  • Turing Machines are Recurrent Neural Networks (Heikki Hyötyniemi)
  • Papers by Ronald J. Williams
  • The DRAMA Architecture
  • The use of recurrent neural networks in continuous speech recognition
  • Phoneme Recognition using Recurrent Neural Networks

• Hopfield Networks
  • Brain-State-in-a-Box (BSB)

• Boltzmann Machines
  • +++ Necker Cube

• Competitive Learning and Self-Organizing Maps
  • Clustering Demo
  • 1D Kohonen map
  • 2D Kohonen map
  • 3D Kohonen map
  • SOM, 2 demos (0D, neighborhood 1 & 2D)
  • SOM
  • Bayesian SOM
  • GNG (Growing Neural Gas) Competitive Learning Models
  • Elastic Net TSP
  • Travelling Salesman Problem
  • Travelling Salesman Problem
  • Data Mining with the SOM
  • A New Look at Seeing

• PCA (Principal Component Analysis)
  • 2D PCA Demo
  • PCA Demo
  • Stock Index Demo
  • Adaptive PCA (Todd Leen)

• ICA (Independent Component Analysis)
  • Tony Bell's ICA page
  • Scott Makieg's page (with FAQs)
  • James Miskin's page

• Demos
  • Many Demo Applets (with code)
  • Perceptron and others
  • Simulated Annealing Demo (minimum finding)
  • Function Approximation
  • Image Compression using Backprop
  • Exact Representations and other demos
  • Hamming Net Image Matching
  • Voronoi Diagram
  • Support Vector Machine (AT&T)
  • Links to more AI demos

• Biological
  • Neuroimaging and letter recognition
  • Functional development: maturation of networks
  • Dynamics of neural networks
  • Perceptual Adaptations

• Adaptive Filters
  • Adaptive Filters
  • ASU Audio demo
  • Eric Wan demo
  • Adaptive Filters (LMS, RLS, variants)

• Control
  • Ball-Balancing
  • Evolving Neural Controllers
  • Pole-balancing (HMC)
  • Incremental neuro-fuzzy systems
  • Inverted Pendulum

• ART Networks
  • ART Clearing House

• Games
  • Backgammon
  • Blackjack (using Reinforcement Learning) (Demo)
  • Go (using Temporal Differences)
  • Machine Learning in Games index
  • NeuroChess
  • NeuroTetris (Defunct)
  • Othello
  • Robotic Soccer

• Radial Basis Function Networks (RBFs)
  • Introduction
  • Links from ANC
  • Training Radial Basis Neural Networks with the Extended Kalman Filter
  • Radial Basis Function Networks in Multiuser CDMA Systems

• Support Vector Machines (SVM's)
  • Support Vector Machines applied to Speech Pattern Classification
  • Support Vector Machine Demo
  • SVM light (Thorsten Joachims)

• Time Series
  • Biomedical Time-Series
  • Spatio-Temporal Networks (Stefan C. Kremer)
  • Time-Series Forecasting
  • Time Series Prediction with Neural Nets
  • Time Series Prediction using SOM's

• Reinforcement Learning
  • Reinforcement Learning (Michael Littman)
  • Reinforcement Learning (Leslie Pack Kaelbling and Michael L. Littman)
  • Neuro-Evolution

• Temporal Difference Method
  • Temporal Difference Learning Model (Dave Touretzky)
  • Temporal Difference Learning and TD-Gammon
  • Sutton's Temporal Difference paper, and others
  • Temporal Difference Simulator (Matlab)
  • Temporal Difference Learning and TD-Gammon (Gerald Tesauro)

• Fuzzy Logic
  • Fuzzy Truck-Backer Demo
  • Inverted Pendulum Demo
  • Application to Molecular Modeling

• Data Sets
  • Chalmers University

• Code
  • Intel's Probabilistic Network Library
  • Mathtools.net (Matlab code)
  • jaNet
  • FuzzyJ Toolit (with Truck Backer and Pendulum demos)
  • +++ Hopfield network (Matlab)
  • +++ Libann
  • LIBSVM (library, with demo)
  • LibSVMTL
  • Matlab SVM
  • SVM Matlab toolbox (Univ. of East Anglia)
  • SVM toolbox for Matlab (TU Graz, Austria)
  • Statistical Pattern Recognition Toolbox (Center for Machine Perction, Czech Republic)
  • lens (Light, Efficient Network Simulator)
  • CMU Matlab
  • Netlab (Aston University)
  • Neurosolutions models
  • +++ PDP++
  • Code for Sutton & Barto book, Reinforcement learning
  • Neural Networking Software
  • Attrasoft Neural network Software (many types of networks, commercial)
  • Neural Networks at your Fingertips (C code)
  • Neural Network Shareware
  • Applet Links
  • UTCS Neural Net Software
  • David MacKay
  • Xerion (U. of Toronto)
  • Linux Software Encyclopedia
  • Neural Networking S\ oftware ft Neural network Software (many types of networks, commercial)
  • Neural Networks at\ your Fingertips (C code)
  • Neural Net\ work Shareware
  • Applet Links
  • UTCS Neural Net Software
  • David MacKay
  • Xerion (U. of Toronto)
  • Linux Software Encyclopedia
  • Neural Integrator (Python)

Matlab

• Review of Matlab toolbox
• Intro. to Matlab
• Matlab Primer
• Mathtools.net (Matlab code)
• Function documentation
• Intro. to Neural Network ToolboxNN Toolbox documentation
• NetLab (Aston University)
• SOM Toolbox

Papers

• A collectoin of downloadable papers on various topics
• Turing Machines are Recurrent Neural Networks

Labs & Centers

• ANC (Adaptive & Neural Computation) at University of Edinburgh
• Aston University NCRG (Neural Computing Research Group)
• Boston University Center for Adaptive Systems
• Caltechn Computation and Neural Systems
• Centre for Neural and Adaptive Systems (University of Plymouth)
• CSBMB (Center for the Study of Brain, Mind, and Behavior (Princeton))CICA (Indiana University)
• CNBC (Center for the Neural Basis of Cognition) (CMU)
• Emergent Learning Research Group (NTT)
• genetic-programming.org
• IEEE Neural Network Council
• +++ IlliGAL
• Lund Observator Sweden
• Navlab
• Neural Networks & Fuzzy Logic Group (FORWISS)
• Neural Networks Research Center, Helsinki University of Technology
• NEuroNet
• Neural Theory of Language
• PNL (Pacific Northwest National Laboratory)

Data

• BU Data
• CMU AI Repository
• Santa Fe Time Series Data
• UCI machine-learning databases

Pages of Links

• Sumeet Gupta's Links
• University of Vienna
• Brain wave links
• Classification Society of North America
• Hopfield's links
• NRC-CNRC Institute for Information Technology
• Andres Perez-Uribe
• Yahoo links
• Pattern Recognition Links
• Reinforcement Learning and Autonomous Robots
• Fuzzy Logic (PC AI)
• Fuzzy Sets and Systems
• More Links
• Face Recognition

Bibliographies

• Bibliographies on Neural Networks
• Gaussian Processes

Neurocomputing People

• Charles W. Anderson
• Andrew G. Barto
• Carlos Brody
• Stephen Grossberg
• Geoffrey Hinton
• Geoffrey Hinton
• John Hopfield
• Stuart Kauffman
• Teuvo Kohonen
• Bart Kosko
• S.Y. Kung
• Todd K. Leen
• Terrence J. Sejnowski
• Richard S. Sutton
• Gerald Tesauro
• Eric A. Wan
• Bernard Widrow

Genetic Algorithm/Programming

• Biological Applications
• Evolutionary Computing Demo System
• Genetic Algorithm
• Genetic Programming Notebook
• Symbolic regression using genetic programming
• Manna Mouse (GA demo)
• +++ Truck-Backer using Genetic Programming
• lil-gp

Commercial

• +++ Attrasoft (Hopfield and Boltzmann nets)
• +++ Statistica

Miscellaneous

• Tricks of the Eye, Wisdom of the Brain

Possible Future Reference

• ZISC (Zero Instruction Set Computer)
• Learning Dynamical Systems
• +++ Recognising Spoken Words from Lip Movement
• The Analog/Digital Distinction in the Philosophy of Mind
• Pulsed Neural VLSI

Other Courses

• Soft Computing (ZITE8145)