The Baseline That Refuses to Die
For a decade, gradient-boosted trees owned tabular machine learning. In the last twelve months tabular foundation models finally — and decisively — beat them on TabArena. But the lesson practitioners are drawing ("stop using trees") is almost the opposite of what the evidence supports, because...