Wiki

Frontier

Reinforcement Learning: An Overview
Theoretical Reinforcement Learning

Courses/Lectures

UW CSE 542: Reinforcement Learning
UW CSE 590A: Systems for ML
Berkeley CS 185/285: Deep Reinforcement Learning
Stanford CS 146S: The Modern Software Developer
Berkeley CS 188: Artificial Intelligence

Cheat sheets

Matrix Cookbook
Math Inequalities
Optimization Inequalities Cheatsheet

Useful Skills

Paper templates and tricks - Yishi Lin
The 7 Habits of Highly Effective People - Stephen Covey
The Art of Presentations - Baochun Li
How to Write Perfect Papers - Baochun Li

Advice

Paper-Reading Survival Kit
How to Study Math
General PhD Guidance

Books

Multi-armed Bandits & Provably Efficient RL

Bandit Algorithms - Tor Lattimore and Csaba Szepesvari
RL Theory
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems - Sebastien Bubeck and Nicolo Cesa-Bianchi
Introduction to Multi-armed Bandits
Markov Decision Process
Parameter Free Learning

Probability Theory

High dimensional probability. An introduction with applications in Data Science - Roman Vershynin
Concentration inequalities and martingale inequalities — a survey - Fan Chung, Linyuan Lu
Concentration of Measure for the Analysis of Randomized Algorithms
A User’s Guide to Measure Theoretic Probability

Quantum

Quantum Computation and Quantum Information

Statistical Estimate

Introduction to Nonparametric Estimation

Game Theory

Algorithmic-Game-Theory

Submodular

Notes on Greedy Algorithms for Submodular Maximization
Adaptive Submodularity

Convex Optimization

Convex Optimization
Introduction to Online Convex Optimization

Causal Inference

The Book of Why

Deep Learning

Neural Networks and Deep Learning
Deep Learning

Writing

Writing Science: How to Write Papers That Get Cited and Proposals That Get Funded
Style Toward Clarity and Grace Chicago Guides to Writing Editing and Publishing
Writing advice - Renee J. Miller
The Elements of Style
On Writing Well
The Craft of Research

Thought-Provoking

Made to Stick: Why Some Ideas Survive and Others Die
Thinking, Fast and Slow
Steal Like an Artist
Show Your Work!

Blogs

I am a bandit - Sebastien Bubeck
Bandit Algorithms - Tor Lattimore
Convex Optimization
Interactive Convex Optimization
OpenAI
DeepMind
BAIR
Lil_RL
Theory of Computing Blog Aggregator
Cool Shell - 陈皓
morvanzhou

Tutorial

Pytorch
Exploration-Exploitation in RL
Theoretical Foundation of RL

Talks

TCS+ Talks
Computer Science and Discrete Mathematics (CSDM)
Simons Institute for TCS
TCS @ Princeton

Math Toolbox

The On-Line Encyclopedia of Integer Sequences(OEIS)
inverse symbolic calculator
mathoverflow
Theoretical Computer Science Stack Exchange
Computer Science Stack Exchange
Mathematics Stack Exchange
WolframAlpha

Programming Language

Python

Basic grammer and design technique

Fluent Python
Effective Python: 90 Specific Ways to Write Better Python

Useful Packages

NetworkX-Software for complex networks
Tensorflow-Open source software library for Machine Intelligence
h5py-A Pythonic interface to the HDF5 binary data format.

Tips

Difference Between Python2.X and Python3.X

C++

C++ Primer
Effective C++
STL 源码剖析

Photography

1x Community
500px Community

Guitar

Tommy Emmanuel
Sungha Jung
Eddie van der Meer
B站苍小天

Games