Wiki

Frontier

Theoretical RL
Causal Inference

Useful Skills

Paper templates and tricks - Yishi Lin
Learning by Doing, advice - Cal Poly
The 7 Habits of Highly Effective People
The Art of Presentations - Baochun Li
How to Write Perfect Papers - Baochun Li

Cheat sheets

Matrix Cookbook
Math Inequalities
Optimization Inequalities Cheatsheet

Advice

Instructions for Ph.D. Students
Paper-Reading Survival Kit
How to Study Math
How to Give Clear Talks
Accelerate Your Coding Skills
General PhD Guidance

Courses/Lectures

ELE524: Foundations of Reinforcement Learning
CSC 696H: Topics in Reinforcement Learning Theory
ELE539/COS512: Optimization for Machine Learning
ECE434/COS434: Machine Learning Theory
videolecture.net
Learning and Optimization for Sequential Decision Making
UCL Course on RL
Convex Optimization

Blogs

I am a bandit - Sebastien Bubeck
Bandit Algorithms - Tor Lattimore
Convex Optimization
Interactive Convex Optimization
OpenAI
DeepMind
BAIR
Lil_RL
Theory of Computing Blog Aggregator
Cool Shell - 陈皓
morvanzhou

Books

Multi-arm Bandit & Provably Efficient RL

Bandit Algorithms - Tor Lattimore and Csaba Szepesvari
RL Theory
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems - Sebastien Bubeck and Nicolo Cesa-Bianchi
Introduction to Multi-armed Bandits
Markov Decision Process
Parameter Free Learning

Probability Theory

High dimensional probability. An introduction with applications in Data Science - Roman Vershynin
Concentration inequalities and martingale inequalities — a survey - Fan Chung, Linyuan Lu
Concentration of Measure for the Analysis of Randomized Algorithms
A User’s Guide to Measure Theoretic Probability

Quantum

Quantum Computation and Quantum Information

Statistical Estimate

Introduction to Nonparametric Estimation

Game Theory

Algorithmic-Game-Theory

Submodular

Notes on Greedy Algorithms for Submodular Maximization
Adaptive Submodularity

Convex Optimization

Convex Optimization
Introduction to Online Convex Optimization

Causal Inference

The Book of Why

Deep Learning

Neural Networks and Deep Learning
Deep Learning

Writing

Writing Science: How to Write Papers That Get Cited and Proposals That Get Funded
Style Toward Clarity and Grace Chicago Guides to Writing Editing and Publishing
Writing advice - Renee J. Miller
The Elements of Style
On Writing Well
The Craft of Research

Thought-Provoking

Thinking, Fast and Slow
Steal Like an Artist
Show Your Work!

Tutorial

Pytorch
Exploration-Exploitation in RL
Theoretical Foundation of RL

Talks

TCS+ Talks
Computer Science and Discrete Mathematics (CSDM)
Simons Institute for TCS
TCS @ Princeton

Math Toolbox

The On-Line Encyclopedia of Integer Sequences(OEIS)
inverse symbolic calculator
mathoverflow
Theoretical Computer Science Stack Exchange
Computer Science Stack Exchange
Mathematics Stack Exchange
WolframAlpha

Programming Language

Python

Basic grammer and design technique

Fluent Python
Effective Python: 90 Specific Ways to Write Better Python

Useful Packages

NetworkX-Software for complex networks
Tensorflow-Open source software library for Machine Intelligence
h5py-A Pythonic interface to the HDF5 binary data format.

Tips

Difference Between Python2.X and Python3.X

C++

C++ Primer
Effective C++
STL 源码剖析

Photography

1x Community
500px Community

Guitar

Tommy Emmanuel
Sungha Jung
Eddie van der Meer
B站苍小天

Games