Preview Mode Links will not work in preview mode

Listen also on: iTunes Spotify      stitcher

Dec 7, 2019

In this Episode we talked about the deep neural networks and the spectral density of each layer's weights. It turns out, you can predict the accuracy ( and many more) with the WeigthWatcher application. We talk about the 5+1 Phases of learning and Heavy Tailed Self Regularization.

Charles Martin, PhD on LinkedIn:

During the episode we talked about these
VC Theory:

Why Deep Learning works? post by Charles Martin, 2015

Presentation at Berkeley: Why Deep Learning works? by Charles Martin, 2016

Several Papers written by Charles Martin and Michael Mahoney:

Newest blog post about weightwatcher, 2019 December:

WeightWatcher on GitHub:
easy installation for python users:
pip install weightwatcher

How to reach out:

To access their slack channel please contact Charles first.

---Copyright Info---
Music is from , intro first part is by Miklos Toth and some free garage band loops. :) intro second part: "Aces High" by Kevin MacLeod, outro "Acid Trumpet" by Kevin MacLeod (, License: CC BY (