Before Leaving OpenAI, Anthropic's President Had a 'Stuffed Animal Advisory Board'

AnthropicOpenAIFounder DepartureAI SafetyCorporate Governance
2 hours agoSource: blockweeks.com
Before Leaving OpenAI, Anthropic's President Had a 'Stuffed Animal Advisory Board'

AI Safety

Author: Li Jia, Wall Street CN

Today, Anthropic has made "AI safety" its core label, but few people know that the company's co-founder and president, Daniela Amodei, once used a group of plush toys with her husband Holden Karnofsky to discuss management issues.

These toys were given different personalities: some were specifically responsible for "having fewer meetings and causing less trouble for oneself," some emphasized rules, details, and execution, and others were responsible for reminding decision-makers to maintain compassion.When facing a thorny workplace issue, Daniela and her husband would have these virtual characters each "express their opinions," thereby simulating the choices that different types of managers might make.

This rather personal, even somewhat childlike, episode took place during the period when Daniela was still working at OpenAI. And it was precisely during this period that she and her brother Dario Amodei were also gradually developing disagreements with OpenAI's management: Daniela had friction with multiple senior executives at work, while Dario began to become increasingly wary of the company's management and the direction of advanced AI development.

In 2020, the siblings ultimately decided to leave OpenAI. This split, later called a "divorce" by insiders, also became the starting point for the birth of Anthropic.

The Atlantic recently cited journalist Kevin Roose's forthcoming book, "The AGI Chronicles," to disclose this little-known experience. In a 2023 interview with Roose, Daniela said this method was "very useful for analyzing different personality types."

From using plush toys to form an "advisory committee" back then, to now growing into an AI giant with thousands of employees, Anthropic has grown from a small AI safety startup into an important player in the industry. According to media reports, the company's potential IPO valuation may approach $2 trillion.

How did a group of plush toys become an "advisory committee"?

This informal "advisory group" was not simply a joke, but a way of thinking that simulated different decision-making styles.

Among them, Jinji was an easygoing cat who tended to reduce Amodei's workload, such as skipping unnecessary meetings; the pink bear Maura represented the completely opposite style—organized, demanding, and detail-oriented; and the panda named Beary Bonds was set to add more compassion and generosity to discussions.

AI Safety

When facing the same workplace issue, the Amodei couple would have the "personalities" represented by different dolls each respond separately.

The real function of this method was not in the toys, but in forcing decision-makers to temporarily step away from their own position and re-examine the issue through another personality.

Essentially, this was a low-cost thought experiment: with no real external advisors, it was still possible to break the same issue into different decision paths through the simulation of different roles.

And almost no one inside OpenAI knew about this method.

Beyond the plush toys, divisions inside OpenAI were widening

At the same time, the relationship between the Amodei siblings and OpenAI was also changing.

Daniela Amodei joined OpenAI in 2018, later moving into a management position on the technical team, and had disagreements with multiple senior executives, including Greg Brockman and Mira Murati.

She and Brockman were once close. Brockman had spoken at her 2017 wedding to Holden Karnofsky, but afterward, their working relationship gradually deteriorated.

Dario Amodei, meanwhile, became increasingly focused on OpenAI's leadership and the direction of advanced AI development, and grew increasingly wary of Sam Altman and Brockman.

At the same time, he began privately organizing activities with a group of researchers who wanted to place greater emphasis on the risks of powerful AI systems. Outside the company's normal structure, these people communicated and held meetings, and some colleagues called this faction "Dario's little circle."

Internal conflicts eventually reached a stage that could not be avoided.

In 2020, Dario began assembling a team willing to leave OpenAI and advance advanced AI research under a different safety philosophy. Daniela became one of the central figures in this departure and was responsible for negotiating with OpenAI while the team prepared to leave.

This split was later privately called a "divorce" by those in the know.

One departure gave birth to an AI giant

In December 2020, the Amodei siblings formally left OpenAI and co-founded Anthropic.

Jack Clark, Sam McCandlish, Tom Brown, Chris Olah, and Jared Kaplan also participated in the company's founding, and Ben Mann was later recognized as another co-founder.

Anthropic was initially just a small research institution centered on AI safety. Afterward, the company gradually expanded to thousands of employees and grew into one of OpenAI's most important competitors.

Daniela Amodei now serves as Anthropic's president and board chair, with authority covering most of research, engineering, product, and business operations. Holden Karnofsky, who was once a member of OpenAI's nonprofit board, later also joined Anthropic.

From using plush toys to simulate managers, to now growing into an AI giant with thousands of employees, this episode also witnessed Anthropic's journey from a startup to maturity.