The Details: Training and Validating Big Models on Big Data