Tag

#benchmarks

Tagged benchmarks 2 posts

21 Sep 2026 blog

Typed Judgments or Agentic Loops? Benchmarking Jev Against a GPT Agent

I spent last week replacing an agentic pipeline with something that isn't an agent at all, and then measuring what I had actually traded away. The task is product classification: take a product description, walk down a category taxonomy (Amazon, Shopify), and land on a leaf node. The old pipeline …

#agents #AI #benchmarks #LLM #typesafe

31 Jul 2026 AI

The Baseline That Refuses to Die

For a decade, gradient-boosted trees owned tabular machine learning. In the last twelve months tabular foundation models finally — and decisively — beat them on TabArena. But the lesson practitioners are drawing ("stop using trees") is almost the opposite of what the evidence supports, because...

#benchmarks #forecasting #foundation-models #gpu #ml #tabular #xgboost