NewForecasting
Mitra-v2: Scaling synthetic pretraining for tabular foundation models
Our short summary of Amazon’s engineering write-up. The full story, with all the detail, is on their blog.
Read the full write-up on amazon.science (opens in a new tab)Problem
Creating a new model for every table required lots of engineering and tuning.
Solution
Trained a foundation model on millions of synthetic tables so it can predict missing values on any new table without extra training.
Top performance on TabArena and ScoringBench benchmarks
Want the architecture, code and numbers? They’re in the original post.
Read the full write-up on amazon.science (opens in a new tab)