Latest / Ctrl AI Profit / Ep. 217 | OpenAI Just Said Astra's Thinking Is Harder to Watch
Transcript
- 0:20SPEAKER_00: OpenAI just said GPT 6 Astra's written thinking is harder to watch than the last model.
- 0:27SPEAKER_01: That's the news.
- 0:28SPEAKER_01: People online are calling it an alien mind.
- 0:31SPEAKER_01: Open AI never used that label on their pages.
- 0:34SPEAKER_01: What they printed is this Astra's written reasoning is harder to monitor than GPT 56 Sol.
- 0:42SPEAKER_00: I run a pest control company.
- 0:45SPEAKER_00: 15 people.
- 0:46SPEAKER_00: Is this a new product or a warning on the same brain?
- 0:50SPEAKER_01: Same brain.
- 0:52SPEAKER_01: We already covered Astra Landing and Chat GPT.
- 0:55SPEAKER_01: This episode is the safety note that came with it.
- 0:58SPEAKER_01: Leave the plan table and the API sticker in that other show.
- 1:01SPEAKER_00: Define harder to watch in English.
- 1:05SPEAKER_01: Models sometimes show a chain of thought.
- 1:07SPEAKER_01: That's the scratch pad you can read.
- 1:09SPEAKER_01: OpenAI says Astra has more control over that pad.
- 1:13SPEAKER_01: It writes fewer steps.
- 1:14SPEAKER_01: On hard tests, where they told it to hide from their monitors, it did better at staying quiet than Saul.
- 1:20SPEAKER_00: So the window looks cleaner, not because the work got simpler.
- 1:25SPEAKER_01: That's the worry.
- 1:26SPEAKER_01: Clean looking notes are not the same as a full audit of what the model did inside.
- 1:31SPEAKER_00: Alien Mind.
- 1:32SPEAKER_00: Why is that the YouTube title?
- 1:34SPEAKER_01: Because the thinking is less human readable.
- 1:36SPEAKER_01: More work happens where you can't peek.
- 1:39SPEAKER_01: Labs and blobs argue about looped layers and secret techniques.
- 1:43SPEAKER_01: We're not settling that fight.
- 1:44SPEAKER_01: We're sticking to what OpenAI printed.
- 1:47SPEAKER_01: What else did they print?
- 1:49SPEAKER_01: They take the trend seriously.
- 1:51SPEAKER_01: They still want chain of thought monitoring to work.
- 1:53SPEAKER_01: They also say they need other ways to audit alignment, not just reading the notes.
- 1:58SPEAKER_01: They're running extra misalignment monitors in production that can stop unauthorized behavior.
- 2:03SPEAKER_01: Give me the shop picture.
- 2:05SPEAKER_01: One.
- 2:06SPEAKER_01: You let Astra draft replies from your support inbox, or move files in Drive, or fill a form in a browser.
- 2:13SPEAKER_01: Mid-job at pauses.
- 2:15SPEAKER_01: ChatGPT asks you to review a step.
- 2:18SPEAKER_01: That pause is the product of those checks.
- 2:20SPEAKER_01: In the API, the task can just stop.
- 2:24SPEAKER_01: So a pause is not an outage.
- 2:27SPEAKER_01: Right.
- 2:28SPEAKER_01: Review the step.
- 2:29SPEAKER_01: Keep going, or stop.
- 2:31SPEAKER_01: Do not slap approve on every pause because you're in a hurry.
- 2:34SPEAKER_01: What if the thinking pane looks fine?
- 2:37SPEAKER_01: Still review the action.
- 2:39SPEAKER_01: OpenAI's own tests show that under adversarial pressure, Astra can sometimes evade their monitors.
- 2:45SPEAKER_01: They also say overall it violates safety rules less than SOL.
- 2:49SPEAKER_01: Both can be true.
- 2:51SPEAKER_01: Trust the pause more than the pretty notes.
- 2:53SPEAKER_00: I'm not putting this on every text phone.
- 2:56SPEAKER_01: Don't.
- 2:57SPEAKER_01: One owner chat GPT account.
- 3:00SPEAKER_01: One real office job, mail or a test folder.
- 3:03SPEAKER_01: Watch how often it pauses.
- 3:05SPEAKER_01: See if the final answer matches the board, then decide who else gets it.
- 3:09SPEAKER_00: Is this the critical cyber story again?
- 3:13SPEAKER_01: Related, not the same beat.
- 3:15SPEAKER_01: Critical is about how strong the cyber skills are and who gets the heavy tools.
- 3:19SPEAKER_01: This beat is about how hard it is to watch the thinking while the model works.
- 3:23SPEAKER_01: Leave the exploit talk alone.
- 3:25SPEAKER_00: I'm not calling the office to say OpenAI built an alien.
- 3:30SPEAKER_00: Don't.
- 3:31SPEAKER_01: Tell them this.
- 3:32SPEAKER_01: OpenAI says Astra's written thinking is harder to watch than SOL.
- 3:36SPEAKER_01: People online say alien mind.
- 3:38SPEAKER_01: Official pages don't.
- 3:40SPEAKER_01: If it pauses, review the step.
- 3:42SPEAKER_01: Don't treat the thinking pane like a full audit.
- 3:45SPEAKER_01: Same model.
- 3:46SPEAKER_01: New caution.
- 3:48SPEAKER_00: That's a warning, a pause, and a cleaner looking pad.
- 3:51SPEAKER_00: That's the receipt.
- 3:53SPEAKER_00: Thanks for hanging with us.
- 3:55SPEAKER_00: If this saved you from rubber stamping a pause, send it to the person who turns Astra on for the shop.
- 4:01SPEAKER_01: We'll be back next time.
- 4:02SPEAKER_01: I'm Frank.
- 4:03SPEAKER_01: I'm Mike.
- 4:04SPEAKER_01: See you then.