Latest / Ctrl AI Profit / Ep. 254 | ChatGPT Can Now See and Control Your Chrome Tabs
Transcript
- 0:20SPEAKER_01: ChatGPT can now read the tabs you have opened in Chrome, and if you let it, it can click around in those tabs and fill out forms for you.
- 0:28SPEAKER_00: That's the news in one sentence.
- 0:31SPEAKER_00: OpenAI announced it on October 15th through its official ChatGPT account.
- 0:36SPEAKER_00: It's an upgrade to the ChatGPT extension for Chrome.
- 0:40SPEAKER_01: Okay, stop right there because half the people listening just heard the word extension and tuned out.
- 0:45SPEAKER_01: What is an extension?
- 0:47SPEAKER_00: An extension is a small add-on you install into your web browser.
- 0:51SPEAKER_00: It sits up by the address bar and it gives some other companies' software a way to see and work with the pages you have open.
- 0:58SPEAKER_00: That's the whole idea.
- 1:00SPEAKER_01: So it's like giving somebody a key to the building, not just letting them look in the window.
- 1:05SPEAKER_01: That's a fair picture.
- 1:07SPEAKER_00: And with this update, OpenAI is using that key two different ways, depending on which part of ChatGPT you're in.
- 1:16SPEAKER_00: Two ways.
- 1:17SPEAKER_00: Give me the first.
- 1:18SPEAKER_00: One.
- 1:19SPEAKER_00: The first is in regular chat.
- 1:21SPEAKER_00: When you tag Chrome in your question, ChatGPT can look across your open tabs to gather information.
- 1:27SPEAKER_00: OpenAI's demo was somebody with three couches open and three tabs, asking ChatGPT to compare them on size, price, delivery time, and return policy.
- 1:37SPEAKER_01: So instead of me copying and pasting three web pages into a chat box, it just reads the tabs I already have open.
- 1:44SPEAKER_00: Right.
- 1:45SPEAKER_00: Reading.
- 1:46SPEAKER_00: Nothing gets clicked.
- 1:47SPEAKER_01: That's the low risk half.
- 1:49SPEAKER_01: And the second way is the one in the title, control.
- 1:53SPEAKER_00: That's in ChatGPT work.
- 1:55SPEAKER_00: Work is the part of ChatGPT that does a task for you instead of just answering.
- 2:00SPEAKER_00: OpenAI says in work, ChatGPT can control your Chrome tabs to send messages, fill out forms, and download files.
- 2:07SPEAKER_00: It can also organize and group your tabs.
- 2:10SPEAKER_01: And here's the part I want people to really hear.
- 2:12SPEAKER_01: This is your Chrome, the one where you're already logged into your email, your bank, your payroll, your customer software.
- 2:19SPEAKER_00: That's exactly how OpenAI describes it.
- 2:21SPEAKER_00: Their help page says ChatGPT can read or act on sites where you're already signed in.
- 2:26SPEAKER_00: And they name examples like Gmail, Salesforce, and internal tools.
- 2:30SPEAKER_01: So that's convenient and a little bit scary in the same breath.
- 2:35SPEAKER_00: Both are true, which is why the settings matter more than the feature.
- 2:39SPEAKER_01: Does it take over my screen while it works?
- 2:42SPEAKER_01: Because I can't have my mouse wandering around on its own while I'm on the phone with a customer.
- 2:48SPEAKER_00: OpenAI says the extension can work across tabs in the background without taking over your browser.
- 2:53SPEAKER_00: You keep working in your tab.
- 2:55SPEAKER_00: It works in its own.
- 2:57SPEAKER_01: Didn't OpenAI have its own web browser for a while?
- 3:01SPEAKER_01: Because I'll tell you right now, nobody at my shop is switching browsers.
- 3:05SPEAKER_00: It did.
- 3:06SPEAKER_00: It was called Atlas, and OpenAI retired it on August 9th.
- 3:11SPEAKER_00: Instead of asking you to switch, they're bringing that work into the browser you already use through this extension.
- 3:17SPEAKER_01: Before we get to settings, there's one more piece.
- 3:58SPEAKER_00: OpenAI's own example is almost that exact prompt.
- 4:01SPEAKER_00: Put the vendors in these tabs into a comparison sheet with pricing and source links.
- 4:06SPEAKER_01: That's 20 minutes of my office manager squinting at three screens, and with the links, she can check every number it pulled.
- 4:14SPEAKER_00: And she should check.
- 4:15SPEAKER_00: The links are there so you don't have to take its word for it.
- 4:18SPEAKER_01: Now the forms.
- 4:19SPEAKER_01: We fill out the same vendor forms, the same credit applications, the same registration pages over and over.
- 4:26SPEAKER_00: That's the work side.
- 4:27SPEAKER_00: You hand it the details and it fills in the form in your tab.
- 4:30SPEAKER_00: And there's a phrase in OpenAI's own sample prompts that I'd tape to the monitor.
- 4:35SPEAKER_00: Stop before submitting.
- 4:37SPEAKER_00: Say that again.
- 4:38SPEAKER_00: Stop before submitting.
- 4:40SPEAKER_00: OpenAI's example is use the details in this event brief to fill out the registration form and stop before submitting.
- 4:47SPEAKER_00: You let it type.
- 4:48SPEAKER_00: You push the button.
- 4:50SPEAKER_01: Okay.
- 4:50SPEAKER_01: Now the settings, because this is where people get burned.
- 4:54SPEAKER_01: What happens the first time it wants to use a website?
- 4:57SPEAKER_00: By default, it asks before it touches each new website.
- 5:00SPEAKER_00: You get four choices allow once, allow for this site, allow for all sites, or decline.
- 5:07SPEAKER_01: And I'm guessing one of those four is the one you don't pick.
- 5:12SPEAKER_00: Allow for all sites.
- 5:14SPEAKER_00: OpenAI's own help page labels it elevated risk.
- 5:18SPEAKER_00: If you choose it, ChatGPT stops asking before it uses websites.
- 5:23SPEAKER_01: So the rule is allow once or allow for one site you trust, never all sites.
- 5:29SPEAKER_00: That's the rule.
- 5:30SPEAKER_00: And there's a block list.
- 5:31SPEAKER_00: In the ChatGPT desktop app, go to Settings, then Computer Use, then Manage Next to Chrome.
- 5:38SPEAKER_00: You can see every site you've allowed and add sites it should never use.
- 5:42SPEAKER_00: That's where the bank goes.
- 5:44SPEAKER_00: And payroll.
- 5:45SPEAKER_00: Yes, and browsing history is handled separately.
- 5:48SPEAKER_00: It asks every time it wants your history, and there's no always allow option for that.
- 5:54SPEAKER_01: What about the stuff it reads?
- 5:56SPEAKER_01: Where does that go?
- 5:58SPEAKER_00: OpenAI says it doesn't keep a separate complete record of your browser actions.
- 6:02SPEAKER_00: What it stores is whatever becomes part of the chat, like text it read from a page or a screenshot.
- 6:09SPEAKER_00: So whatever it reads ends up in the chat, and your normal chat GPT data settings apply.
- 6:15SPEAKER_00: One more worry.
- 6:18SPEAKER_00: OpenAI's help page tells you to treat page content as untrusted.
- 6:23SPEAKER_00: In plain words, a web page can have text on it meant to steer the AI.
- 6:27SPEAKER_00: That's one more reason it asks before using new sites, and one more reason you don't leave it unattended on anything with money or passwords.
- 6:35SPEAKER_01: Who can use this?
- 6:36SPEAKER_01: Do I need some big, expensive plan?
- 6:40SPEAKER_00: OpenAI says the extension is available on every ChatGPT plan.
- 6:44SPEAKER_00: What you can do with it depends on your plan and your rollout, and on a company account, your admin's workspace settings, there are no new prices in the announcement, so we're not quoting any.
- 6:54SPEAKER_00: And it's not only Chrome.
- 6:57SPEAKER_00: The help page lists Chrome, Edge, Brave, Opera, and Vivaldi.
- 7:02SPEAKER_00: Opera doesn't get the side panel, but it can still do the tab work from the desktop app.
- 7:08SPEAKER_01: Alright, give me the takeaway.
- 7:09SPEAKER_01: Somebody's listening in the truck.
- 7:12SPEAKER_01: What do they actually do?
- 7:14SPEAKER_00: First, on your office computers, open Chrome, go to extensions, then manage extensions, and see if ChatGPT is already installed.
- 7:24SPEAKER_00: One of your people may have added it already without telling anybody.
- 7:28SPEAKER_01: Second, if it's there, open the ChatGPT desktop app, settings, computer use, manage next to Chrome, and look at what's on the allowed list.
- 7:36SPEAKER_01: Put the bank and payroll on the blocked list.
- 7:40SPEAKER_00: Third, try the safe version first.
- 7:42SPEAKER_00: Three supplier tabs, ask chat for a comparison table with links, reading only, no clicking.
- 7:49SPEAKER_01: And when you graduate to forms, you say stop before submitting every time.
- 7:54SPEAKER_00: What to ignore?
- 7:56SPEAKER_00: The idea that you need to hand it your whole browser on day one?
- 7:59SPEAKER_00: You don't.
- 8:00SPEAKER_00: What to wait on?
- 8:01SPEAKER_00: Letting it send messages or download files for you until you've watched it do the boring stuff right a few times.
- 8:08SPEAKER_01: That's the profit.
- 8:09SPEAKER_01: You didn't have to install it, poke at every setting, and find out the hard way, which button means everything.
- 8:15SPEAKER_01: Read tabs first, one site at a time, stop before submitting.
- 8:19SPEAKER_00: One sentence to repeat.