Learning Line by Line