Learning More from a Loss