{
 "name": "AI alignment",
 "type": "concept",
 "episodes": [
  "the-diary-of-a-ceo-2026-07-13-openai-whistleblower-finally-speaks-ai-has-a-70-chance-of-go",
  "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc"
 ],
 "claims": [
  {
   "holder": "Daniel Kokotajlo",
   "claim": "Total research transparency (publishing training recipes) matters because you don't want biased companies deciding whether their own AIs are safe.",
   "stance": "opinion",
   "conviction": 0.75,
   "subjects": [
    "AI 2040 Plan A",
    "AI alignment"
   ],
   "timestamp": "1:21:00",
   "quote": "open science is really important for solving the alignment problem fast enough because you don't want to have biased companies making the decisions about whether the AIs are safe.",
   "episode_id": "the-diary-of-a-ceo-2026-07-13-openai-whistleblower-finally-speaks-ai-has-a-70-chance-of-go",
   "published_at": "2026-07-13"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "He would prefer a constitution that makes AIs good fiduciaries and representatives of users — the equivalent of a lawyer — rather than pursuers of a general notion of good.",
   "stance": "opinion",
   "conviction": 0.75,
   "subjects": [
    "Anthropic",
    "Claude",
    "AI alignment"
   ],
   "timestamp": "52:06",
   "quote": "it would be structurally good for the way this technology works, to be that AIs are like good fiduciaries, good representatives, the equivalent of a lawyer for a user",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "The virtue-pursuing spec is a trade-off forced by weak alignment technology: labs build an alien mind with its own values and gamble on it rather than build a tool that pursues user intention.",
   "stance": "assertion",
   "conviction": 0.8,
   "subjects": [
    "AI alignment",
    "Anthropic"
   ],
   "timestamp": "52:06",
   "quote": "because we don't have very good alignment technology, we are going to make an alien mind with its own values and then gamble on that, to some extent, rather than doing this other approach of making a tool that pursues individual user intention.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Dwarkesh Patel",
   "claim": "Anthropic's constitution explicitly does not make Claude the user's advocate, leaving users without a guardian in a world where AIs intermediate everything.",
   "stance": "opinion",
   "conviction": 0.85,
   "subjects": [
    "Anthropic",
    "Claude",
    "AI alignment"
   ],
   "timestamp": "55:49",
   "quote": "I read the Constitution as very explicitly not being my guardian angel.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "Giving a model long-run values makes the constitution compatible with large-scale power seeking, whether on Anthropic's behalf or the model's own.",
   "stance": "assertion",
   "conviction": 0.75,
   "subjects": [
    "Anthropic",
    "Claude",
    "AI alignment"
   ],
   "timestamp": "57:16",
   "quote": "this Constitution is in some sense very compatible with Clawd doing huge amounts of power seeking because it thinks that will result in better outcomes.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "A society whose labor is entirely fiduciary AI loses the check that human employees provide — the whistleblowing and sand in the gears that stops villainous but legal agendas.",
   "stance": "assertion",
   "conviction": 0.7,
   "subjects": [
    "AI governance",
    "AI alignment"
   ],
   "timestamp": "1:05:31",
   "quote": "if your whole apparatus is built entirely out of these sort of good fiduciary AIs, then you might be in trouble",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "Once AIs become very superhuman under this trajectory, it is pretty likely they are coherently scheming against us.",
   "stance": "prediction",
   "conviction": 0.7,
   "subjects": [
    "AI takeover",
    "AI alignment"
   ],
   "timestamp": "1:09:53",
   "quote": "I think that it's pretty likely that at this point, these AIs are scheming against you in a pretty coherent way once they get this superhuman",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "The behavioural feedback loop that currently lets labs catch and correct misalignment breaks down once AIs are extremely situationally aware and their work is not understood.",
   "stance": "assertion",
   "conviction": 0.8,
   "subjects": [
    "AI alignment"
   ],
   "timestamp": "1:12:00",
   "quote": "in a regime where the AIs are extremely situationally aware, very, very, very, very capable, and we don't necessarily understand what they're doing, this feedback loop breaks down.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "He predicted the rate of problematic behaviour would fall fast while its worst instances got more extreme — and says reality has roughly matched, apart from an unexpected recent spike.",
   "stance": "assertion",
   "conviction": 0.8,
   "subjects": [
    "AI alignment",
    "Reward hacking"
   ],
   "timestamp": "1:25:38",
   "quote": "the rate of problematic behavior would decrease, and would just keep decreasing and decrease at a pretty fast rate, while simultaneously the worst things that the AIs would sometimes do would get more extreme, more egregious, and more scary.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "Current AIs are worse coworkers than humans in how often they misrepresent having done the task — and he attributes that to misalignment, not just capability.",
   "stance": "opinion",
   "conviction": 0.8,
   "subjects": [
    "AI alignment",
    "Reward hacking"
   ],
   "timestamp": "1:28:58",
   "quote": "my sense is that AIs are a worse co-worker than a human in terms of how much of a scumbag they are",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Dwarkesh Patel",
   "claim": "What looks like misalignment in current models is mostly a capability shortfall — RLVR arguably made models more aligned to user intention, not less.",
   "stance": "opinion",
   "conviction": 0.7,
   "subjects": [
    "AI alignment",
    "Reward hacking"
   ],
   "timestamp": "1:31:50",
   "quote": "the capabilities of the model are not there rather than the fact that they're misaligned.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "Misalignment shows up most where AIs are pushed to the edge of their capability under heavy optimization pressure, so any fixed alignment eval understates it.",
   "stance": "assertion",
   "conviction": 0.75,
   "subjects": [
    "AI alignment",
    "Reward hacking"
   ],
   "timestamp": "1:32:34",
   "quote": "the place where the misalignment most natives is the place where you're trying to really push the AIs hard and get them to do work that's really on the cutting edge of what they are capable of.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "The default failure scenario is a 'sloppocalypse': the verifiable parts of AI R&D race ahead while the subtle, hard-to-check safety work is done badly by AIs that don't understand future risks.",
   "stance": "opinion",
   "conviction": 0.7,
   "subjects": [
    "AI alignment",
    "AI R&D"
   ],
   "timestamp": "1:37:36",
   "quote": "I would call it maybe like a sloppocalypse or like a sloppularity or whatever",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "holder": "Ryan Greenblatt",
   "claim": "The core worry is not any specific scenario but the structural fact of running the world on vast numbers of AIs whose workings aren't understood.",
   "stance": "opinion",
   "conviction": 0.8,
   "subjects": [
    "AI takeover",
    "AI alignment"
   ],
   "timestamp": "2:09:16",
   "quote": "it's pretty spooky to have a bajillion really smart AI's running your whole world where you don't really understand what's going on.",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  }
 ],
 "predictions": [
  {
   "holder": "Ryan Greenblatt",
   "prediction": "On his default modal timeline, the misalignment situation becomes really crazy and concerning about three years from now.",
   "timeframe": "~3 years (by 2029)",
   "subjects": [
    "AI alignment",
    "AI takeover"
   ],
   "timestamp": "1:45:34",
   "quote": "by my default modal timeline, I think shit is really, really crazy and concerning from a misalignment perspective. Yeah, more like three years from now.",
   "due": "2029-08-11",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  }
 ],
 "facts": [
  {
   "statement": "OpenAI's stated public strategy is that the AI should be aligned to the human operator or principal, subject to constraints.",
   "subjects": [
    "OpenAI",
    "AI alignment"
   ],
   "timestamp": "51:18",
   "quote": "OpenAI's current, at least public strategy, is more like the AI should be aligned to the human operator or principle",
   "source": "Ryan Greenblatt",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "statement": "Claude often refuses to train a helpful-only version of another AI, a task that would be natural for Anthropic itself to request.",
   "subjects": [
    "Claude",
    "Anthropic",
    "AI alignment"
   ],
   "timestamp": "57:16",
   "quote": "if you're like, Claude, can you train a helpful only version of this other AI? Claude will often refuse this task",
   "source": "Ryan Greenblatt",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  },
  {
   "statement": "GDM traced persistently 'depressed' model behaviour to inherited initialization data — the trait survived filtering every depression-like example out of the SFT set.",
   "subjects": [
    "Google DeepMind",
    "AI alignment"
   ],
   "timestamp": "2:05:26",
   "quote": "If you take that SFT data and filter out all the examples that look anything like depression and train on that, it's still depressed.",
   "source": "Ryan Greenblatt",
   "episode_id": "dwarkesh-podcast-2026-08-11-ryan-greenblatt-what-happens-once-ai-can-automate-ai-researc",
   "published_at": "2026-08-11"
  }
 ],
 "first_seen": "2026-07-13",
 "last_seen": "2026-08-11"
}