Learning in neural networks
Summary
Artificial Neural Networks are inspired by Biological Neural Networks. One big difference is that optimization in Deep Learning is done with the BackProp Algorithm, whereas in biological neural networks it is not. We show what biologically plausible learning algorithms can do (and what not).
Content
- Why BackProp is biologically not plausible. Biological two-factor rules and neuromorphic hardware
- Hebbian Learning (two-factor rules) for PCA and ICA
- Two-factor rules for dictionary learning (k-means/competitive learning/winner-takes-all)
- Three-factor rules and neuromodulators (theory and neuroscience)
- Three-factor rules for reward-based learning (theory)
- Three-factor rules for TD reinforcement-learning (algorithmic formulations)
- Actor-critic networks
- Reinforcement learning in the brain
- Learning by surprise and novelty: exploration and changing environments (algorithmic)
- Surprise and novelty in the brain
- Learning representations in multi-layer networks (algorithms without backprop)
- Learning to find a goal: a bio-plausible model with place cells and rewards
- Neuromorphic hardware and in-memory computing
Keywords
- Hebbian learning and two-factor rules
- distributed local algorithms,
- Principal Component Analysis/Independent Component Analysis (PCA and ICA)
- Reinforcement Learning (RL)
- surprise and novelty
- three-factor rules
- neuromorphic hardware
Learning Prerequisites
Required courses
Linear Algebra AND Analysis.
Machine learning
Recommended courses
Signal processing
Important concepts to start the course
Optimization, Gradient Descent, Filtering, Loss function, Eigenvalues,
Learning Outcomes
By the end of the course, the student must be able to:
- Translate concepts from machine learning and signal processing into bio-plausible algorithms
- Translate neuroscience of learning into algorithms
- Explain differences between and similarities of various algorithms
- Discriminate imitations and advantages of various learning algorithms for implementation in biology or hardware
Transversal skills
- Plan and carry out activities in a way which makes optimal use of available time and other resources.
- Set objectives and design an action plan to reach those objectives.
- Evaluate one's own performance in the team, receive and respond appropriately to feedback.
- Give feedback (critique) in an appropriate fashion.
- Manage priorities.
- Continue to work through difficulties or initial failure to find optimal solutions.
Teaching methods
Ex cathedra, Exercises, and Miniproject
Expected student activities
Participation in Class, Solution of Exercises, Miniproject.
Assessment methods
Oral exam (70 percent) plus miniproject (30 percent). If more than 45 students participate, the oral exam is replaced by a written exam.
Supervision
| Office hours | No |
| Assistants | Yes |
| Forum | Yes |
In the programs
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional
- Semester: Spring
- Exam form: Oral (summer session)
- Subject examined: Learning in neural networks
- Courses: 2 Hour(s) per week x 14 weeks
- Exercises: 1 Hour(s) per week x 14 weeks
- Lab: 1 Hour(s) per week x 14 weeks
- Type: optional