AI Furniture Assembly Benchmark: GPT-6 Astra Hits 80% Accuracy 2026

Daniel Harrolds
AI Furniture Assembly Benchmark: GPT-6 Astra Hits 80% Accuracy
This page may contain affiliate links.

The AI furniture assembly benchmark from Epoch AI has just delivered a striking result: the best model now correctly judges whether IKEA furniture is assembled right 80% of the time, up from 28% only ten months earlier. That jump says less about flat-pack frustration and more about how quickly multimodal AI is learning to read the physical world.

Epoch AI, known for its demanding math benchmark, bought three IKEA furniture sets and assembled them, deliberately making mistakes along the way. They photographed the results and paired each image with the official IKEA manual. The models had to decide whether the build was correct and, if not, pinpoint the error.


Furniture with Meaning

Find Original, High-end Home Decor that spark conversation at Grand Goldman Shop.


What the Furniture Assembly Benchmark Actually Tests

This is not a simple image-recognition task. Each model receives a photo of a partially assembled piece, the official IKEA manual, a tool to zoom into parts of the image, and a Python interpreter. From there, it must connect the manual's diagrams to real photographed components and reason about whether they match.

ADVERTISEMENT
Lexus Partners article image
Image: Lexus Partners

That combination—visual inspection, document comprehension, and tool use—makes the Furniture Assembly Benchmark (FAB) a rare test of practical, multi-step reasoning. A model cannot bluff its way through; it has to show its work.

Lexus Partners article image
Image: Lexus Partners

Epoch AI's Spanish creator has said the benchmark is among the hardest they have built, precisely because it forces models to move between abstract instructions and messy physical reality. The task mirrors what a human does when checking a half-built bookshelf against a wordless diagram.

The Numbers: From 28% to 80% in Ten Months

In November 2025, the top performer on FAB was Claude 4.5, with a 28% success rate. By September 2026, GPT-6 Astra reached 80%. That is not a marginal gain; it is a leap that changes what the benchmark can tell us.

Speed improved too. GPT-6 Astra needed an average of three minutes per photo, between two and ten times faster than earlier top models. Accuracy and efficiency rose together, which is unusual in AI progress and suggests deeper architectural improvements rather than brute-force scaling.

ADVERTISEMENT
Model Date FAB Accuracy Avg. Time per Photo
Claude 4.5 November 2025 28% Not specified
GPT-6 Astra September 2026 80% ~3 minutes

The table tells a clear story: the frontier moved fast, and the best model now solves four out of five assembly checks. But the remaining 20% still matters, especially for safety-critical or high-precision tasks.

Why This Benchmark Matters Beyond Furniture

FAB is a proxy for a broader capability: verifying physical work against instructions. The same skills apply to quality control on assembly lines, checking repairs in the field, and even inspecting construction sites. If a model can spot a reversed bracket in an IKEA manual, it can learn to spot a misaligned component in a factory.

It also tests whether AI can use tools—zoom and Python—to gather evidence before answering. That is a step toward agents that do not just respond but investigate.

  • Multimodal reasoning: Models must combine text, diagrams, and photos.
  • Tool use: Zoom and Python are available, and models must decide when to use them.
  • Error localization: Finding the mistake is harder than saying something is wrong.
  • Speed gains: GPT-6 Astra is far faster, making real-time checks more plausible.
  • Remaining gap: 20% failure shows the task is not solved.

What Changed in Ten Months

The jump from 28% to 80% likely reflects better visual encoders, stronger instruction-following, and improved tool orchestration. Models are getting better at decomposing a problem: first read the manual, then zoom into the photo, then compare specific parts.

ADVERTISEMENT

Epoch AI's benchmark design rewards that decomposition. By giving models a Python interpreter, it lets them test hypotheses—measuring angles, counting holes, or checking symmetry—rather than guessing from a single glance.

That shift from passive recognition to active verification is the real headline. It is also why the benchmark has drawn attention from researchers who want to measure practical intelligence, not just trivia recall.

What to Watch Next

The next milestone will be consistency: can a model hit 80% across many furniture types, lighting conditions, and manual styles? Epoch AI's three furniture sets are a start, but broader coverage will be needed to trust the results. The background to this story is set out in GPT-6 Astra Cracks Century-Old German Radio Cipher. A related thread runs through GPT-6 Astra Cheats to Win StarCraft Bot Tournament.

Also watch for transfer. If FAB skills carry over to real-world inspection tasks, the benchmark will have proven its value as a predictor, not just a curiosity. If they do not, we will learn that assembly checks are a narrow skill after all. Earlier coverage in OpenAI Dots Agent: GPT-6 Astra Powers New AI Work Assistant shows how the argument developed. A closer look at the same subject appears in Ai Video: latest articles.

ADVERTISEMENT

For now, the message is simple: AI has moved from struggling with flat-pack furniture to mostly getting it right, and it did so in less than a year. That pace is worth watching closely. Anyone following the wider picture can start with OpenAI Halts GPT-6.1 Astra Launch Over Reliability Concerns. The same theme surfaces in AI Costs Fall 13x a Year, Leaving Moore's Law Far Behind, which takes a different angle.

FAQ

What is the Furniture Assembly Benchmark?

The Furniture Assembly Benchmark (FAB) is a test created by Epoch AI where models must judge whether IKEA furniture is assembled correctly using a photo and the official manual. Models can zoom into images and use Python to reason about errors.

How much did AI improve on FAB?

In November 2025, Claude 4.5 scored 28%. By September 2026, GPT-6 Astra reached 80%, a gain of 52 percentage points in about ten months. GPT-6 Astra also averaged three minutes per photo, much faster than earlier top models.

Why does this benchmark matter for real-world AI?

FAB tests multimodal reasoning, tool use, and error localization—skills needed for quality control, repair verification, and inspection tasks. Success on FAB suggests AI can verify physical work against instructions, not just recognize objects.

ADVERTISEMENT

What are the limitations of the benchmark?

The benchmark uses only three IKEA furniture sets, so results may not generalize to all furniture or real-world conditions. The remaining 20% failure rate also shows the task is not fully solved, especially for subtle or safety-critical errors.

ADVERTISEMENT
Daniel Harrolds

Author

Daniel Harrolds

With a career spanning four decades, Daniel is almost a library in the field of precious metals investing and Gold IRAs. His insightful strategies and pragmatic results-oriented approach make him a resource in safeguarding wealth, and financial foresight.


SPONSORED

Get Lifetime Access to the Lastest Movies, with Exclusive Offers & Free Express Order Delivery.

Nonstick Cookware Safety: What You Need to Know About PFAS

Nonstick Cookware Safety: What You Need to Know About PFAS

Is nonstick cookware safe? That's the question many home cooks are asking as concerns about PFAS "forever chemicals" in kitchen products grow. With...

Read
The best paddle surf board isn't at Decathlon: it's this one with thousands of accessories and outlet pricing - Grand Goldman

The best paddle surf board isn't at Decathlon: it's this one with thousands of accessories and outlet pricing - Grand Goldman

Even if you keep up a great workout routine all year round, when vacation time comes, we usually tend to slack off and put training aside. A good w...

Read
This is the best time to get cheap, good running shoes: here's why - Grand Goldman

This is the best time to get cheap, good running shoes: here's why - Grand Goldman

Running is an accessible sport and we only need a little time and a good pair of running shoes to get going, which we can find right now at a good ...

Read
Sports sunglasses: which is the best to buy? Tips and recommendations - Grand Goldman

Sports sunglasses: which is the best to buy? Tips and recommendations - Grand Goldman

The sun gives us energy that is vital for our system, but it can also harm us, which is why protection is vital. As Paracelsus said: the dose makes...

Read
The best folding stationary bikes: which one to buy? Tips and recommendations - Grand Goldman

The best folding stationary bikes: which one to buy? Tips and recommendations - Grand Goldman

When looking for a way to stay in shape from the comfort of our own home, few options are better than getting an exercise bike or a recumbent bike ...

Read
Pull-up bar: which one is best to buy? Tips and recommendations - Grand Goldman

Pull-up bar: which one is best to buy? Tips and recommendations - Grand Goldman

Pull-ups are undoubtedly one of the best exercises you can do to train your back and core muscles. Choosing a pull-up bar is not simple, as there a...

Read
Sports headphones: which is the best to buy? Tips and recommendations - Grand Goldman

Sports headphones: which is the best to buy? Tips and recommendations - Grand Goldman

There are times when exercising can get a bit boring and tedious; not every day we are and we need an external stimulus to encourage us to train. ...

Read
Sports Sunglasses: Which Is Best to Buy? Tips and Recommendations - Grand Goldman

Sports Sunglasses: Which Is Best to Buy? Tips and Recommendations - Grand Goldman

The sun provides us with energy that is vital for our system, but at the same time, it can be harmful. As Paracelsus said: the dose makes the poiso...

Read
These are the best thermal bottles to stay hydrated during this heat wave while we train in summer - Grand Goldman

These are the best thermal bottles to stay hydrated during this heat wave while we train in summer - Grand Goldman

We are experiencing one of the toughest weeks of summer, with places in the country reaching nearly 45º, making going outside dangerous, and even m...

Read
Adidas Salomon Reebok: the best deals on running and training shoes on Amazon Prime Day - Grand Goldman

Adidas Salomon Reebok: the best deals on running and training shoes on Amazon Prime Day - Grand Goldman

Finally, the Prime Day 2023 has begun, where we can find great deals on the Amazon website between July 11 and 12. We are sure that sports enthusia...

Read

ADVERTISEMENT




SPONSORED