Latest / How I Work / The AI critique system we use to improve our work
Transcript
- 0:00Speaker 1: If you've ever hit send on a document report or
- 0:03Speaker 1: slide deck and then immediately thought, hmmm, I hope that
- 0:07Speaker 1: lands okay.
- 0:08Speaker 2: This episode is.
- 0:10Speaker 1: For you because producing a high quantity of work isn't
- 0:14Speaker 1: the hard part anymore. It's producing high quality, which means
- 0:19Speaker 1: checking it, stress testing it, making sure it's clear, accurate,
- 0:23Speaker 1: and actually says what you meant before someone else points
- 0:27Speaker 1: out the gaps. Now, sure, you can enter a basic
- 0:30Speaker 1: prompt into AI to ask it to review your work.
- 0:33Speaker 1: But today Neo and I are going to level up
- 0:37Speaker 1: the way you can use AI to make your work
- 0:40Speaker 1: better and not to replace your judgment, but to sharpen it.
- 0:44Speaker 2: You're gonna learn how to get AI to.
- 0:46Speaker 1: Critique your work properly, not just polish it, ask for
- 0:50Speaker 1: feedback on clarity, logic, bias, and gaps, and we're gonna
- 0:53Speaker 1: give you one mega prompt to review emails, documents, slides,
- 0:57Speaker 1: or anything you like. Really, by the end of this episode,
- 1:01Speaker 1: you won't be guessing whether your work is good enough.
- 1:04Speaker 2: You're going to have a clear, repeatable.
- 1:06Speaker 1: Way to pressure test it before it leaves your desk,
- 1:10Speaker 1: and the confidence to decide what to change and what
- 1:13Speaker 1: to stand by. Welcome to how I AI with me
- 1:23Speaker 1: Doctor Amantha Imba and Neo Applin, head of Inventium AI.
- 1:27Speaker 1: Each episode we share one practical way to use AI
- 1:31Speaker 1: better at work and in life. No fluff, no dech jargon,
- 1:35Speaker 1: just things you can use straight away. So on previous episodes, Neo,
- 1:40Speaker 1: you've referred to how we can get AI.
- 1:42Speaker 2: To review our own work.
- 1:45Speaker 1: But I want to get into the nitty gritty of
- 1:48Speaker 1: how do we do that beyond just a simple prompt like,
- 1:51Speaker 1: you know, put your critical thinking hat on AI and
- 1:55Speaker 1: tell me what I could improve, Like how do we
- 1:56Speaker 1: get a little bit more sophisticated.
- 1:59Speaker 3: You need to tell it what you wanted to do
- 2:01Speaker 3: and also tell it exactly what you wanted to review
- 2:04Speaker 3: and check. So I've got I've called it Charles, So
- 2:08Speaker 3: I've created myself an agent to a GPT and Charles
- 2:12Speaker 3: reviews my stuff. Now I've put in a little bit
- 2:14Speaker 3: more specifics around it, but at its essence, this more
- 2:18Speaker 3: than two sentences is what you need to write. So
- 2:21Speaker 3: I've got review the last response. Of course, you could
- 2:23Speaker 3: say review the document, review this thing that I've uploaded,
- 2:26Speaker 3: whatever it is, perform a rigorous critique to find anything incorrect.
- 2:31Speaker 3: Weekly supported, unclear, incomplete, biased, impractical, verbose, wordy, or improbable.
- 2:39Speaker 3: So as you can tell, I'm going through all the bases,
- 2:42Speaker 3: I want you to review it and just go through
- 2:44Speaker 3: everything that could be wrong with it, then propose better
- 2:47Speaker 3: alternatives and provide a corrected slash revised version. So you
- 2:52Speaker 3: could just get away with that one line. So's that's
- 2:57Speaker 3: enough to be able to get it to review it.
- 2:58Speaker 3: Because what you're being here is about what you want
- 3:01Speaker 3: to review it. So you could say I want to
- 3:03Speaker 3: find instead off anything incorrect, weekly, supported, unclear, and complete.
- 3:07Speaker 3: You could say anything that is against our policies, anything
- 3:11Speaker 3: against you, how our operating process are, or anything against
- 3:16Speaker 3: how I think a CFO would want to review this paper,
- 3:19Speaker 3: those kind of things. So be specific about how you
- 3:21Speaker 3: want your agent, your chat thread to be able to
- 3:24Speaker 3: review your work. So that's an easy thing. So review
- 3:27Speaker 3: the last response and then put in all those things.
- 3:29Speaker 3: And we'll put that prompt in the show notes as well.
- 3:33Speaker 1: And in fact, we will actually do better than that, because
- 3:35Speaker 1: I think we're going to have the whole system instructions
- 3:39Speaker 1: for Charles.
- 3:40Speaker 2: Is that right?
- 3:41Speaker 1: Oh?
- 3:41Speaker 3: Okay? And if you're infratrate, okay, we're going to give
- 3:44Speaker 3: you Charles. So this is what Charles does. So I
- 3:47Speaker 3: call it Charles because I use it so often, I
- 3:49Speaker 3: may as well give it a name, So we'll give
- 3:51Speaker 3: you Charles. So Charles has that task, but Charles also
- 3:55Speaker 3: has a couple of steps after that that it follows.
- 3:58Speaker 3: So the first is it goes what do I think
- 4:00Speaker 3: Neo's really trying to do? And what do I think
- 4:03Speaker 3: He's really wanting me to check? And that's a really
- 4:05Speaker 3: important thing for you to see. Is AI actually checking
- 4:07Speaker 3: the things that I want it to check? And it
- 4:09Speaker 3: understands me. It goes to equality gates. So in other words,
- 4:13Speaker 3: what it says is have you passed these main categories
- 4:17Speaker 3: and the categories I've given it is factual accuracy, logical soundness, completeness, relevance, clarity, structure, safety,
- 4:24Speaker 3: and practicality. So it goes through those and effectively gives
- 4:27Speaker 3: me a tick or a cross, so I can see
- 4:29Speaker 3: if he goes biased, Okay, I've got to go in
- 4:31Speaker 3: there and change those kind of things, or practical sound,
- 4:34Speaker 3: factual accuracy, those kind of things. Then it goes through
- 4:37Speaker 3: and tells me some of the main points that I
- 4:41Speaker 3: could have added to or I could have changed. So
- 4:43Speaker 3: it's effectively a diagnostic audit, so it says how important
- 4:47Speaker 3: this is, how confident it is about how important that is,
- 4:51Speaker 3: or the problems there. So if you've got a high
- 4:54Speaker 3: severity like this is really important, but a low confidence
- 4:57Speaker 3: is like, well, I'm not sure i've been to to
- 5:00Speaker 3: your work neo. But if I've interpreted right, high importance
- 5:04Speaker 3: those kind of things, it'll tell you what problem it's got,
- 5:08Speaker 3: whether it's like a user experience, a structure or clarity whatever,
- 5:11Speaker 3: and it tells you what the problem is where and
- 5:13Speaker 3: what you can do to fix it. Also gives you
- 5:16Speaker 3: a bunch of alternative approaches. So for these things that
- 5:19Speaker 3: you've got in this work, the document, the email you
- 5:21Speaker 3: wanted to review, whatever it is, it will then say,
- 5:24Speaker 3: here's some alternative approaches on how you can potentially fix this.
- 5:29Speaker 1: So can I understand just day to day because I
- 5:33Speaker 1: feel like I hear you use Charles a lot, So
- 5:36Speaker 1: what are the kinds of tasks that you're bringing in
- 5:40Speaker 1: Charles for? And just to confirm, Charles is a GPT
- 5:43Speaker 1: and chat GPT for you, Is that right? Yes, that's great, yes,
- 5:47Speaker 1: But equally it could be a project in Chlaude. It
- 5:50Speaker 1: could be an agent in co Pilot, it could be
- 5:52Speaker 1: a gem in Gemini.
- 5:54Speaker 3: Yes, absolutely, or it could just be a prompt in
- 5:56Speaker 3: your prompt library you dump in whenever you need.
- 5:58Speaker 1: Okay, so tell me what are the kinds of tasks
- 6:00Speaker 1: that you're using Charles for?
- 6:03Speaker 3: Anything with analysis, I'm getting it to check my analysis.
- 6:07Speaker 3: So if I'm doing a review or some kind of
- 6:10Speaker 3: a document or whatever, then I'm getting Charles to review
- 6:13Speaker 3: that and give me their or its opinion on what
- 6:16Speaker 3: I think what it thinks can be improved in this work. Now,
- 6:19Speaker 3: by the way, sometimes Charles comes up with suggestions like, yeah,
- 6:22Speaker 3: I get that, but no, you don't know the background
- 6:25Speaker 3: like I do, and so I don't have to change it.
- 6:27Speaker 3: But those kind of things I was running through Charles.
- 6:32Speaker 3: I'd done a social post. We've got online communities for
- 6:35Speaker 3: AI people learning AI, and I had already done a
- 6:38Speaker 3: social post, and I thought, oh, I forgot to put
- 6:40Speaker 3: that through Charles, and so I posting it. I put
- 6:44Speaker 3: the social post into Charles, and it gave me a
- 6:47Speaker 3: couple of suggestions on how I could quickly go in
- 6:49Speaker 3: there and do some tweaks to make my social post
- 6:51Speaker 3: clear out so it can be anything from social posts
- 6:54Speaker 3: to emails to documentsy working on analysis as you're doing
- 6:59Speaker 3: slide you can give I've given slide decks to in
- 7:02Speaker 3: the past, a whole bunch of different things, so pretty
- 7:05Speaker 3: much anything you're doing. If you would love to get
- 7:08Speaker 3: a second opinion, then get Charles to give you that
- 7:11Speaker 3: second opinion. So I'm not quite there. I still haven't
- 7:15Speaker 3: built it into everything I do, but anything important I
- 7:18Speaker 3: get Charles to have a look at. But I think
- 7:20Speaker 3: it's almost like a spell check, Like we get word
- 7:24Speaker 3: to do a spell check and a grammar check for
- 7:26Speaker 3: anything we then do and then upload or give to
- 7:30Speaker 3: a colleague. It's a good idea to get AI to
- 7:33Speaker 3: do a review to see whether you can improve those
- 7:36Speaker 3: things before you give it to those people. Why that
- 7:39Speaker 3: review doesn't take much because of course AI is just
- 7:41Speaker 3: doing the review. You can agree or disagree with those things,
- 7:43Speaker 3: and quite often it's like, oh, that's a really good pickup,
- 7:45Speaker 3: and I'm just going to do small tweaks. So it's
- 7:47Speaker 3: like the third thing we're doing spell check, grammar check,
- 7:50Speaker 3: get it to do a your Charle's check, and of
- 7:52Speaker 3: course we're giving you the we're going to give you
- 7:53Speaker 3: the COVID Charles, so you can run that yourself.
- 7:56Speaker 1: How well does it work if AI has been primarily
- 7:59Speaker 1: responsible for creating the output, Like, let's just say, you know,
- 8:04Speaker 1: as sadly many people are, they're just kind of taking
- 8:07Speaker 1: shortcuts with AI.
- 8:08Speaker 2: They're being a bit lazy. They're producing some AI slop.
- 8:11Speaker 1: You know, maybe they've put in three bullet points and
- 8:13Speaker 1: they're like, write me a three page report that I
- 8:15Speaker 1: can give to my bus on this particular topic or
- 8:18Speaker 1: project update. Is it good at critiquing its own work
- 8:22Speaker 1: when the prompter's been lackluster and you know, maybe the
- 8:26Speaker 1: AI's output is actually not that good.
- 8:28Speaker 3: Yeah, I was a bet to joke and say it'll
- 8:31Speaker 3: recognize its own handywork and say that's awesome. No, it
- 8:34Speaker 3: doesn't do that. It'll even improve AI's output as well.
- 8:39Speaker 3: So it's a good thing to get this as a
- 8:42Speaker 3: second opinion AI. So if you've been working with A
- 8:44Speaker 3: on a document or whatever, even if you have just
- 8:47Speaker 3: been like phoning it in and saying five top points,
- 8:49Speaker 3: give me a document, it will still review that and
- 8:51Speaker 3: tell you how that could be improved. So don't take
- 8:55Speaker 3: AI's output first output as gospel ever, like I prefer,
- 9:00Speaker 3: using AI's output is to augment me, not to do
- 9:03Speaker 3: the work for me. But yes, you can get it
- 9:06Speaker 3: to review AI's output and we'll actually give you a
- 9:08Speaker 3: better response and'll actually tell you where the flaws are
- 9:10Speaker 3: where it could be improved. So yes, absolutely use it for.
- 9:14Speaker 1: That amazing So for anyone listening, we are very or
- 9:20Speaker 1: i should say NEO is very generously sharing Charles with you. All.
- 9:25Speaker 1: Just pop into the show notes and there will be
- 9:27Speaker 1: a link to get the full text in markdown to
- 9:31Speaker 1: paste into your GPT agent project of choice, or.
- 9:36Speaker 2: You can just use it as a mega prompt.
- 9:38Speaker 1: So enjoy Charles, maybe give it its own name, and
- 9:43Speaker 1: we will see you next Monday. If you found this useful,
- 9:47Speaker 1: please help us spread the AI love and share it
- 9:50Speaker 1: with someone who you think would benefit from knowing what
- 9:53Speaker 1: you now know. And if you're ready to really start
- 9:56Speaker 1: mastering AI, check out inventium dot ai. We help individuals, teams,
- 10:01Speaker 1: and organizations turn Jenai into a real work superpower, saving
- 10:07Speaker 1: ten plus hours a week and staying future already without
- 10:10Speaker 1: the jargon or overwhelmed.
- 10:12Speaker 2: Thanks so much for listening, and we'll see you next
- 10:14Speaker 2: time on.
- 10:14Speaker 1: How IAI how i AI was hosted by me Amantha
- 10:19Speaker 1: Imber and Neo Applan.
- 10:21Speaker 2: A big thank you to Martin Imber who does our
- 10:23Speaker 2: sound editing, and
- 10:24Speaker 1: Jem Rubio for production support, and thank you to John
- 10:27Speaker 1: Kilby who composed the theme music.