Learning in neural networks

Summary

Artificial Neural Networks are inspired by Biological Neural Networks. One big difference is that optimization in Deep Learning is done with the BackProp Algorithm, whereas in biological neural networks it is not. We show what biologically plausible learning algorithms can do (and what not).

Content

Keywords

- Hebbian learning and two-factor rules

- distributed local algorithms,

- Principal Component Analysis/Independent Component Analysis (PCA and ICA)

- Reinforcement Learning  (RL)

- surprise and novelty

- three-factor rules

- neuromorphic hardware

Learning Prerequisites

Required courses

Linear Algebra AND Analysis.

Machine learning

Recommended courses

Signal processing

Important concepts to start the course

Optimization, Gradient Descent, Filtering, Loss function, Eigenvalues,

Learning Outcomes

By the end of the course, the student must be able to:

• Translate concepts from machine learning and signal processing into bio-plausible algorithms
• Translate neuroscience of learning into algorithms
• Explain differences between and similarities of various algorithms
• Discriminate imitations and advantages of various learning algorithms for implementation in biology or hardware

Transversal skills

• Plan and carry out activities in a way which makes optimal use of available time and other resources.
• Set objectives and design an action plan to reach those objectives.
• Evaluate one's own performance in the team, receive and respond appropriately to feedback.
• Give feedback (critique) in an appropriate fashion.
• Manage priorities.
• Continue to work through difficulties or initial failure to find optimal solutions.

Teaching methods

Ex cathedra, Exercises, and Miniproject

Expected student activities

Participation in Class, Solution of Exercises, Miniproject.

Assessment methods

Oral  exam (70 percent) plus miniproject (30 percent). If more than 45 students participate, the oral exam is replaced by a written exam.

Supervision

Resources

Moodle Link

• https://go.epfl.ch/CS-479