Notes, demos and materials for learning Machine Learning

In addition to the material in this git repository, I've also used materials from my computer vision, data mining and deep learning modules. Please feel free to take a look at the lecture slides and notes for these which can be found here:

• http://comp3204.ecs.soton.ac.uk / https://github.com/jonhare/COMP3204
• http://comp6237.ecs.soton.ac.uk / https://github.com/jonhare/COMP6237
• http://comp6248.ecs.soton.ac.uk / https://github.com/jonhare/COMP6248

(Note that this is only a guide. We'll adapt the content to your needs during the course.)

• Monday 26th July 2021: Overview of Machine Learning

  • Leaders: Prof Niranjan, Prof Prugel-Bennett and Dr Hare
  • 10:00-10:30
    • Introductions: Course teachers and students
  • 10:30-11:00
    • Coffee
    • Chat in Break out rooms
  • 11:00-12:30 Niranjan
    • ML in one page Niranjan
    • Artificial Idiots Adam
    • Failures of machine learning Jon
  • 12:30-2:00
    • Lunch (exercise)
  • 1:30-3:00 Niranjan
    • Understanding simple machine learning algorithms
      • Linear models, Gaussian distributions
    • Bayes Optimal Regression
    • Fisher Discriminant Analysis
    • Peceptron
  • 3:00:3:30
    • Coffee (break out rooms)
  • 3:30-5:00 Niranjan
    • Feature selection and Lasso
  • 7:00 Dinner
    • Kings

• Tuesday 27th July 2021: Introduction to Machine Learning

  • 9:00-10:30 Adam
    • How to do Machine Learning
  • 10:30-11:00
    • Coffee/break out rooms
  • 11:00-12:30 Jon
    • Handling Data
    • Hands-of practical session
    • Introduction to python, scikit-learn and CoLab
  • 12:30-1:30
    • Lunch
  • 1:30-3:00 Niranjan
    • MLPs
    • Gradient learning, SGD, momentum
  • 3:00-3:30
    • Coffee
  • 3:30-5:00
    • Evaluating performance
      • ROC curves
    • Homework
  • 7:15 Dinner

• Wednesday: 28th July 2021: Advanced Machine Learning

  • Leader: Adam
  • 9:00-10:30
    • Generalisation
      • Bias-Variance Dilema
    • Kernel methods
      • SVM
      • kernels
  • 10:30-11:00
    • Coffee
  • 11:00-12:30
    • Ensemble Techniques
    • Bagging, random forest and Boosting
  • 12:30-1:30
    • Lunch
  • 13:00-3:00
    • Bayesian Inference
  • 3:00-3:30
    • Coffee
  • 3:30-5:00
    • Probability Models
      • Gaussian Processes and Naive Bayes
    • Homework
    • Extra exercises: http://comp6248.ecs.soton.ac.uk/labs/lab1/
  • 7:00 Dinner_

• Thursday 28th July 2021: Deep Learning

  • *Leader: Jonathon
  • 9:00-10:30
    • Why Deep
      • CNNs
      • RNNs (LSTM, etc.)
  • 10:30-11:00
    • Coffee
  • 11:00-12:30
    • Word Embeddings
    • Loss functions
    • GPU programming (libraries)
  • 12:30-1:30
    • Lunch
  • 1:30-3:00
    • Keras tutorial 1 - building simple CNNs
    • Transfer Learning
    • Keras tutorial 2 - transfer learning with CNNs
  • 3:00-3:30
    • Coffee
  • 3:30-5:00
    • Keras tutorial 3 - Text classification
    • Keras tutorial 4 - Sequence modelling
    • Current research challenges
      • Visual
        • segmentation
        • object detection
        • multi-label classification
      • Text
        • sequence-sequence learning
          • translation, embedding, etc
          • logical inference & QA
      • Cross-modal transfer
        • generating from embeddings
        • VQA
      • GANs
    • Homework
  • 7:00 Dinner

• Friday 30th July 2021: Practical Machine Learning

  • Leaders: Prof Niranjan, Prof Prugel-Bennett and Dr Hare
  • 9:00-10:30
    • Workshop on data you provide
    • We will look at (slides):
      • Analyse the problem
      • Visualise the data
      • Cleaning the data
      • Using machine learning libraries
      • Evaluate performance
  • 10:30-11:00 Coffee
  • 11:00-12:30
    • Work on data
  • 12:30-1:30 Lunch
  • 13:00-3:00
    • Practical ML
  • 3:00-3:30 Coffee
  • 3:40 Taxi to station