Zuck's Manifesto, Point by Point

Zuckerberg published a 6,500 word manifesto on superintelligence for everyone. Here is what he argues, and where I stand on each point.

1. WHO GETS ACCESS

Zuck says: "The defining questions of our age are who will have access to superintelligence." He wants it distributed widely, not centralized in a few institutions.

My take: Superintelligence will exist, and the question is not even who gets access. It is who can afford it. It is just like cloud compute, or CPUs, or GPUs. Those with deeper pockets afford more. The advantage compounds: the more compute you can buy, the more you build, the more you can afford. The gap between those who can direct a lot of superintelligence and those who can direct very little will become a socio-economic divide that accelerates on its own. Tie that with genetic engineering, and you end up with a full species bifurcation. Distribution sounds nice on paper. It rarely works that way.

2. AI AND JOBS

Zuck says: People fear AI will take jobs, and the fear is not baseless. Automation could outpace what individuals can learn. But he argues capability growth can match or outpace automation, and that new kinds of jobs will emerge that do not exist today, the way app developers and social media creators did a generation ago.

My take: History says he is right. Every Gutenberg moment scared people. Every time, society adapted and ended up more prosperous. The printing press did not end the need for readers, it created an industry around them. The outcome is likely the same here. The transition is the painful part, not the destination. The jobs that disappear are visible today. The jobs that appear are impossible to imagine until they exist.

3. INVENTION VS AUTOMATION

Zuck says: "Invention, not automation, will be the greatest contribution of superintelligence." AI will help people discover and create, not just do routine work.

My take: Funny he says that. Right now AI is trained, not creative. It does not invent on its own. Today the real value is automation, doing more with less, and AI is the greatest automation tool ever built. Invention can come later. The present belongs to automation.

4. BALANCE OF POWER

Zuck says: "There is no such thing as a singular benevolent superintelligence." Competing interests check and balance each other, so the answer is to distribute power to individuals.

My take: I am not sure there is balance coming. Right now this is a race for domination, not a market of checks and balances. The framing assumes competitors stay independent. Five labs trained on the same data with the same methods are not five independent actors.

5. DISTILLATION

Zuck says: "It is important to protect the principle that you can learn from anything you can observe. This is how the world works." Distillation should not be framed as harmful.

My take: Agreed. Everything learns from everything. Distillation is just how intelligence propagates. Jensen said it, I said it this morning, now Zuck says it. The "distillation attack" frame is dying.

6. ALIGNMENT

Zuck says: Alignment should mean the agent shares your goals and values, not the company's. Enforcing a centralized set of values is a dogma.

My take: Here I disagree. The company does not impose values, it sets guardrails. That is not a centralized dogma, it is a societal moral compass, and it is critically important. Personal alignment without boundaries is a license to do harm.

7. GOVERNANCE

Zuck says: He is giving Meta's independent board the power to approve model releases, and he encourages other labs to do the same instead of leaving it to CEOs.

My take: Fine. But everyone has been talking about structural oversight for years, and no one has executed. Talk is cheap. Show me the governance that actually constrains a release.

8. BANNING FOREIGN MODELS

Zuck says: Restricting access to foreign open source models is not an effective solution. It centralizes AI and reduces the quality available to people. The US should win by building better models, not walls.

My take: Agreed. Banning protects no one. It should be a global free market. The answer to the open source race is speed, not walls.

Zuck's manifesto is worth reading in full, because AI is the most disruptive piece of technology of our lifetimes, and right now it is deciding the fate of humanity. We should all be paying attention to where it is headed, because we are all along for the ride.