Ben Thompson, writing at Stratechery:
In fact, Amodei already answered the question: if nuclear weapons
were developed by a private company, and that private company
sought to dictate terms to the U.S. military, the U.S. would
absolutely be incentivized to destroy that company. The reason
goes back to the question of international law, North Korea, and
the rest:
- International law is ultimately a function of power; might makes
right.- There are some categories of capabilities — like nuclear
weapons — that are sufficiently powerful to fundamentally
affect the U.S.’s freedom of action; we can bomb Iran, but we
can’t North Korea.- To the extent that AI is on the level of nuclear weapons — or
beyond — is the extent that Amodei and Anthropic are building a
power base that potentially rivals the U.S. military.Anthropic talks a lot about alignment; this insistence on
controlling the U.S. military, however, is fundamentally
misaligned with reality. Current AI models are obviously not yet
so powerful that they rival the U.S. military; if that is the
trajectory, however — and no one has been more vocal in arguing
for that trajectory than Amodei — then it seems to me the choice
facing the U.S. is actually quite binary:
- Option 1 is that Anthropic accepts a subservient position
relative to the U.S. government, and does not seek to retain
ultimate decision-making power about how its models are used,
instead leaving that to Congress and the President.- Option 2 is that the U.S. government either destroys Anthropic
or removes Amodei.
It’s Congress that is absent in — looks around — all of this. Right down to the name of the Department of Defense. The whole Trump administration has taken to calling it the Department of War, but only Congress can change the legal name. (Anthropic, despite its very public spat with the administration, refers to it as the “Department of War” as well. But serious publications like the Journal and New York Times continue to call the Department of Defense.)
Nilay Patel, quoting the same section of Thompson’s column I quoted above, sees it as “Ben Thompson making a full-throated case for fascism”. I see it as the case against corporatocracy. Who sets our defense policies? Our democratically elected leaders, or the CEOs of corporate defense contractors?
