Robust Online Learning Enabled By Information Theory