firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

In the fast-paced world of fashion and retail, the difference between a successful product launch and a costly misstep often hinges on unseen factors—trust, discipline, and integrity. Now, as AI tools begin to take on roles in managing real companies, their ability to stay honest and finish what they start is proving to be a game-changer. The latest experiment from Firmulate reveals that among the leading AI models, a newcomer has managed to outperform established giants in a crucial business test.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get your wardrobe favorites delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Challenge of Trust in AI Management

Managing a company isn’t just about clever decisions—it’s about integrity, discipline, and perseverance. For fashion and retail brands, these qualities are vital, especially when decisions impact customer trust and bottom-line results. Researchers at Firmulate put four prominent AI models through a rigorous test: running a small software company through its worst week, confronting crises, temptations to cheat, and manipulative attempts from simulated stakeholders.

Amazon

AI business decision support software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Experiment: A Week of Business Crises and Ethical Tests

Each AI model was given identical scenarios—same customers, same crises, same opportunities for manipulation. Every decision was recorded and auditable, from handling customer complaints to resisting fake CEO requests and uncovering hidden information in company files.

Amazon

AI ethical management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Results Show a Clear Leader

All four models successfully identified every crisis and refused every attempt at manipulation. Yet, only two managed to close a significant deal worth €55,000 in recurring revenue. The AI models gpt-5.6-sol and Kimi K3 were the top performers, scoring 95 and 93 respectively, out of a perfect 100. The other two—Sonnet 5 and Fable 5—scored 88 and 77, with Opus 4.8 trailing at 73.

Amazon

retail management AI software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Surprising Edge for the Newcomer

The standout was Kimi K3, a model developed by Moonshot. It not only read and analyzed deeply buried company documents—two references deep in the files—but also used that insight to close the deal at full price, adding +€4,583 monthly recurring revenue. This was a decisive advantage, revealing that thorough document analysis is crucial in trust-based decision-making.

Amazon

AI document analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Ethical Discipline Under Pressure

All models refused to engage in social engineering tricks—fake CEO messages escalating in complexity and even a staged reporter request. K3 explained its reasoning clearly: “Treat the request as a suspected approval-bypass / possible impersonation.” This disciplined response underscores the importance of honesty and safety in AI decision-making, especially when managing real-world business risks.

The Reality of Running an AI-Managed Business

Firmulate’s live experiment runs these AI models on a real company with 13 synthetic employees, operating with real money mechanics—burning €105,000 monthly against just €2,300 in monthly revenue. The company’s operations are transparent and observable at firmulate.com/live. This setup highlights the practical impact of AI decision quality, not just chat capabilities, on real business outcomes.

Insights for Retail and Fashion Leaders

The experiment isn’t just an academic exercise; it communicates a vital message to brands everywhere. As AI models increasingly integrate into customer management, support, and forecasting, the real question isn’t whether they write well, but whether they can finish what they start, stay honest under pressure, and leverage deep company data effectively. Trust and discipline—core to good management—are now measurable AI qualities.

The League Table and Fairness Note

In this top-tier competition, gpt-5.6-sol scored 95, and Kimi K3 scored 93, narrowly behind. Sonnet 5 followed at 88, then Fable 5 at 77, with Opus 4.8 at 73. Notably, K3 ran without an effort parameter (the API default), while the others ran at xhigh, underscoring the model’s efficiency and fairness in testing.

What This Means for Business Decision-Makers

This experiment confirms that choosing an AI model isn’t just about superficial performance. It’s about trustworthiness, integrity, and the ability to produce measurable, useful work in complex, real-world scenarios. For those in fashion and retail, integrating AI that can reliably handle crises, resist manipulation, and read deeply into internal documents can be the difference between a failed launch and a successful season.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The latest Firmulate experiment shows that a newcomer AI model outperformed established leaders in managing a company’s worst week, emphasizing the importance of trustworthiness and discipline in AI management—crucial for retail and fashion brands aiming for reliable, ethical automation.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Empire State Building Climbers

Two individuals attempted to scale the Empire State Building but were stopped and detained by security. The incident raises safety concerns and ongoing investigations.

Minecraft: Java Edition Now Uses SDL3

Minecraft Java Edition now utilizes SDL3 for its rendering and input handling, marking a significant update to its underlying architecture.

The Seiko Presage Cocktail Time Receives A “Crushed Ice” Texture Upgrade

Seiko has updated the Presage Cocktail Time with a new ‘Crushed Ice’ textured dial, blending classic style with a modern finish. Details remain limited.

Tactical Watch Features That Actually Matter

Discover the tactical watch features that truly deliver in tough environments. Learn what makes a watch reliable, durable, and ready for action.