Worklife with Molly Graham - Can AI make you a better manager_ with Hilary Gridley
Summary
本期围绕“AI能否让管理者变得更好”展开,主持人莫莉·格雷厄姆与希拉里·格里德利探讨了技术效率与人类判断之间的边界。她们认为,管理者的核心职责仍是让团队产生大于个体之和的成果,并清楚定义成功标准、提供正确语境和帮助成员达到要求。AI不会消除这些基本功,反而会放大清晰沟通、判断力和品味的重要性,因为错误信息也能借助AI以前所未有的速度扩散。希拉里分享了把自己的高管沟通标准编码进定制GPT的实践,说明AI最适合解决团队成员真实感受到的痛点,而不是替管理者强加新的流程。她同时警告,不应把客户访谈、信息综合和洞察提炼等能够锻炼核心认知能力的工作全部外包给AI,否则人会失去形成判断的过程。制作AI工具的真正价值之一,是迫使管理者把隐性的经验、品味和“什么叫好”转化为可解释、可教授的明确标准。面对泛滥的AI低质文档,管理者应坚持成果质量、通过示范和结对学习展示正确用法,并从每天尝试一个略有难度的小任务开始培养AI能力。
Highlights
-
Keeping a group of teenagers alive 100 feet below the surface of the ocean is like, oh, and now I have to get a report approved to move forward. Those are not on the same level of difficulties. I had a flow chart that I still reference sometimes that was like, should you panic? A ...
让一群青少年在海面下100英尺处活着回来,与“现在我得让一份报告获批才能继续推进”根本不是同一级别的难题。我以前有一张至今偶尔还会参考的流程图,标题是“你该恐慌吗?”,第一个判断就是:有人正处于人身危险之中吗?
Molly Graham A memorable real-world test for workplace panic -
What happens when two teams disagree about what is the right context, right? About what is truth, which happens so often in companies. Who wins in a tie? What do we actually care about here? And what do we consider data that is instructive versus data that is noise?
如果两个团队对什么才是正确语境、什么才是真相意见不一,会发生什么?这种情况在公司里极其常见。出现分歧时谁说了算?我们真正关心什么?哪些数据具有指导意义,哪些只是噪声?
Hilary Gridley Shows why AI makes managerial judgment more important -
If getting 10 times better at that thing is going to make me 10 times more effective in my job, I actually don't want to automate that because I want to get as good at that thing as possible. The act of making the report is only partially about the artifact at the end. So much of ...
如果把一件事做得好十倍能让我在工作中有效十倍,那我其实不想自动化它,因为我希望自己尽可能精通这件事。制作报告的意义只有一部分在于最终产物,更重要的是抵达结果的过程会如何塑造你的大脑。
Hilary Gridley A sharp heuristic for deciding what not to automate -
Even if you stop at the step of write out the criteria for what good work looks like or what you care about, even just that would make you better than 99% of the managers out there. If it seems impossible for you to explain to someone else what good looks like in your domain, in ...
即使你只做到写下“好工作是什么样”或“你真正看重什么”的标准,仅仅这一步也会让你胜过99%的管理者。如果你觉得无法向别人解释自己领域里的“好”是什么样,那很可能说明你思考得还不够。
Hilary Gridley Turns tacit taste into a concrete management standard -
AI sort of shows you what's going on inside a person's brain, and it is an amplifier. If you are doing really thoughtful work, the AI can be an amazing amplifier for getting that thoughtfulness out at a bigger scale. But if you're just tapping a button and saying, hey Claude, wri ...
AI在某种程度上会暴露一个人脑子里正在发生什么,而且它是一个放大器。如果你本来就在认真思考,AI能把这种思考放大到更大规模;但如果你只是按下按钮说“嘿,Claude,替我写一份第三季度战略”,产出的就会是垃圾内容。
Hilary Gridley A vivid diagnosis of why AI slop proliferates
Full transcript
Hilary GridleyIf you are doing really thoughtful work, the AI can be an amazing amplifier for getting that thoughtfulness out at a bigger scale. But if you're just tapping a button and going in and saying, oh, we need a Q3 strategy, like, hey, Claude, write a Q3 strategy for me, that's what's going to be sloped. I have one pretty strongly held belief when it comes to AI and all the stuff that's happening right now.
Molly GrahamThat belief is that there are things about being human that aren't going anywhere. The messy relational judgment heavy stuff, the art and taste and intangible stuff, the part of work and creativity that is almost impossible to teach or explain. That stuff not going anywhere. My hope for AI is that it replaces all the like repetitive menial work that humans should never have been doing in the first place. Like data entry or repetitive rule-based tasks or complex research and analysis that can take months and months and months. Things that aren't actually a good use of the power or the scope of a human brain. That's what I think AI should be for. And if it can take over that work for us, then I think it lets us, the human, focus on things that we're uniquely good at.
Molly GrahamI've told you that once in a while, I'm going to do an AI curiosity episode where I talk to someone who is deeply embedded in the AI world about a topic. And my goal with these episodes is to help us all learn what is real and what is not in all this AI chatter and also what is worth our energy day to day. Today, I want to explore something deeply human at work. Management. Managing people is relational.
Molly GrahamIt requires judgment and taste, knowing and seeing the person sitting across from you. The best managers I've seen do something I've never believed you can systematize. They help people become better versions of themselves. To be clear, there are a lot of bad managers out there.
Molly GrahamIn fact, bad management is something you are almost guaranteed to experience in your work life. But in general, even though many of us are still learning how to be great at it, management is, I would say, the human kind of work that AI will never replace because we're talking about two complex human beings and a lot of nuance and feelings and judgment.
Molly GrahamAnd yet there are people who are making the case that AI should have a really big role in management. People I respect and whose judgment I trust. Today, I'll be speaking with one of them. And I'm going to bring all my curiosity and all my skepticism. Can AI actually make you a better manager? Or does it just give you a faster way to do the job badly?
Molly GrahamI'm Molly Graham, and this is WorkLife, where we untangle the messy human side of work. Hillary Gridley has spent years leading teams at companies like Woop. More recently, she's known for her work helping managers use AI to coach people and give feedback and develop talent more effectively. In the process, she's found herself wrestling with questions that every manager eventually runs into. What is good judgment?
Molly GrahamWhere does it come from? And is it something that you can teach? And can you teach it to AI? Hillary thinks that the answers to all these questions are more complicated than I've been allowing for. So today, we're going to get her take on AI and management, but we're also going to talk about things like judgment and what might have become more valuable, not less as machines get better at doing our jobs.
Hilary GridleyHillary Gridley, welcome to Work Life. I'm so happy you're here. Oh, I'm so excited to be here. Can I tell you why I'm so excited to be here and talk to you? Yeah, totally. So your writing has obviously been so influential to managers working in high-growth companies dealing with a lot of change. And so I've been a fan for a long time. But it wasn't until I read your waterline piece where I was like, oh my god, Molly was a wilderness instructor. And I was a scuba instructor.
Hilary Gridleyand I feel like these are simpatico because back in the day like my friends were going to get internships and I was like I'm gonna go teach scuba diving and everyone was like that's a stupid idea and I believe to this day that that has informed so much of my own management style and I'm like very much of the belief that the future belongs to people who take inspiration from unexpected places because all the unexpected places are kind of getting mined.
Hilary GridleyUh, so I was like, when I saw it about you, I was like, I have a new theory now that like this instruction is the best management training that exists. Totally. So I literally.
Molly Grahamthink that Knowles, which was where I taught, you know, where I led wilderness trips was my absolute best management training. I feel like so much of my like grounding as a manager came from there. Wait, so where, where did you instruct scuba? I taught scuba diving for a company called Broadreach, great, great company in the Caribbean. We were leading adventure trips for young people. And yeah, I tell people all the time, like.
Molly GrahamKeeping a group of teenagers alive 100 feet below the surface of the ocean is like, oh, and now I have to get a report approved to move forward. Those are not on the same level of difficulties. Yeah, I feel like for me, having a little bit of life and death, not a lot of life and death, because obviously everything we were doing was pretty safe, made everything more real. When you're in an office, you're kind of like,
Hilary GridleyWhat's the worst thing that could happen? Do you know it's not that bad? Totally. I had a flow chart that I still reference sometimes that was like, should you panic? And the first break was, is anybody in physical danger? Totally. And if it was like no, it was like, is there a chance of imminent physical danger? No.
Molly GrahamOkay, there's nothing to stress about. What are we worried about here? It's such a good test for what I would call the front country, which is what most people think of as management. Because if the answer to both those questions is no, then what are we stressed about? Arguably, you probably shouldn't panic even if the answer is yes.
Molly GrahamAt least you have an understanding of the stakes at hand. Panic after. No, I love that. Well, you're actually getting into it. I mean, obviously, what I want to talk to you about today, which is like...
Molly Grahammanagement, which is one of the most human things that I think we do. And this whole world of AI that's showed up, and you've obviously spent a lot of time speaking and teaching and writing about the intersection. Like how can AI help managers and people leaders become better at their jobs? But I actually want to start just by grounding us in something more fundamental, which is sort of like, what do you believe? What is Hillary's version of what the role of a manager is?
Hilary GridleySure. So fundamentally, I think a manager is just somebody who makes their team more than the sum of their parts, right? Like you are a multiplier for the team. They are able to accomplish things that they would not be able to accomplish without you. And what that means, how you do that, obviously there's a lot of nuance there and it can change depending on the team. But I think kind of the fundamental piece is can you articulate what good looks like, right? And that's good in the role. That's good for the work. Like do you have a clear point of view?
Molly Grahamfor what success means, for what good looks like, can you show that, articulate that to your team, and can you help them reach that bar? Yeah, that's a great definition. I always say, too, that, like, I think great managers make people the best version of themselves, make space for people to be the best version of themselves, but I love what you said, too, which is, like, that one plus one equals four, right? Exactly.
Molly GrahamYou're not just every individual human sort of doing their thing. It's about how you make a team work together, which is part of what I hear in your answer. OK, well, so out of curiosity, has AI and sort of like the advent of these robots that we have a relationship with change anything about that definition for you? About the definition? No. So much of what I.
Hilary Gridleyfind very interesting about this. And I should say up front, I'm very into AI. I use a lot of AI. I am what they call AI-pilled, which I think it maybe surprises people because I also consider myself very human-centered in how I think about work, how I think about management. And I don't see these things as at odds. And so much of my work with AI, both as a manager who was using a lot of AI and how I led my team when I was at Woop, the wearables company, but also in how I build products and building AI products, like working on our AI coach at Woop. You go through this sort of phase when you first start working on it where you're like, oh my gosh, everything is changing so much. Like my job every year was unrecognizable compared to the previous year in the year since chat GBT came out. And yet you come out the other side of that thinking the fundamentals
Hilary Gridleyare more true than ever and more unchanged than ever. So an example of that is you hear a lot of people who are thinking about how to implement AI in the context of an enterprise focused on context, right? We need to find a way to give AI, the robots as I like to call it, the right context about our company, about our strategy, about our people, our products so that it can make good decisions.
Hilary GridleyNow in theory, you should be able to just write all of this up in a series of documents and load that into whatever system you're using and the robots can draw on that. But what happens when two teams disagree about what is the right context, right? About what is truth, which happens so often in companies. Like one team really believes that having a good user experience as measured by net promoter score is the most important thing. And another team believes that growth as measured by revenue per user is the most important thing. And those things are going to butt heads constantly. And so you start to have disagreements about what matters the most. What is even the truth? What are we trying to do? So this exercise of trying to put all your context into a system so that the AI can use it,
Hilary Gridleyis suddenly like, well, hold on, who wins in a tie? What do we actually care about here? And what is actually the truth? And what do we consider data that is instructive versus data that is noise? And those are all deeply human and deeply managerial type questions that have always been the job of manager to solve that across the company. And now if you don't solve that, It gets so much worse because everyone can move so much faster and everyone can produce so much more. So just like the impact that one really high performer can have in a company has gone up a lot in the age of AI. So too has the impact that.
Hilary Gridleya person who is operating from completely incorrect information can also have. And so I think of that about, again, the fundamentals of the manager's job to make sure everybody at the company, human and robot alike, has the right context in order to make the best possible decisions they can. But that's not a straightforward process. And it is, as I said, more important than ever that managers are good at doing that.
Molly GrahamYeah, there's so much inside what you just said that I want to unpack. And you're actually really underscoring something that I was just talking to someone about yesterday, because there's this whole conversation in the AI world and the tech world as if, almost as if management's going away. You hear all these things around the super IC, the super individual contributor. Everyone's job now is to do, not to manage.
Molly GrahamYou know, you even hear like Facebook saying like, oh, now we have one manager for every 50 people, which implies like almost like management is less important or easier or something like that. And the interesting thing I think is that what I've actually experienced is the opposite, which is almost like every single person in the world that is going to decide to work with AI became a manager because the skills of, you know, making a robot do what you want it to do are almost identical to the skills of making a human do what you want it to do. But I am curious what your process was of sort of going from maybe hearing about these tools or being skeptical of them and certainly being skeptical of them as useful in management to actually using them. What was that like for you? Yeah, so I was super skeptical of
Hilary Gridleybasically all aspects of it, you know, can it do good work? Is it like anti-human in some way? Like all the reasons that people are skeptical, I was skeptical. And I started using it because in my job I was working on building AI products, so working on our AI coach within the Whoop product. And I noticed that the engineers who were working on the AI product We're working in a very different way than engineers in other part of the organization. They were working in what we now consider like a very kind of AI native way of building. And so it was a lot more of things like just sort of defining what they wanted the product to do or the feature to do and finding ways to evaluate whether it was doing that successfully rather than like writing the prescriptive code for exactly what it should do.
Hilary Gridleyand I was curious whether this was transferable outside of engineering. And so I started using it thinking about ways I could do some of the things I saw them doing as a manager and thinking about in the same way that the engineers were less focused on the actual code writing and more focused on communicating what the code needed to do, were there ways I could do similar things with my team.
Hilary GridleyAnd that's what inspired some of my early experiments, some of which did not work at all with any product. I probably had, I think I made five or six GPTs, and then one of them was extremely useful. And then I learned from that, and I started making more useful things like that. And then it just sort of spiraled from there. And I realized that there's a lot of nuance in how you set up these systems. There are ways to to design AI systems that I do think are kind of anti-human, that I do think sort of erode the cognitive abilities of the people who work in those systems. But there are also ways to set up systems that do the opposite, that make the people smarter, that make the people better. I've talked about how some of the tools that I've built.
Hilary Gridleyare ways to help people on different teams who speak very different languages kind of communicate better with each other by better understanding how that other team is like thinking about problems. And so that made me like very excited and passionate about learning more about where are the places that people are using this technology and ways that are helping people like their work more, do better work rather than like more kind of scary ways.
Hilary GridleySo, will you just give an example of like, you know, sort of your first eye opening or some of your early eye opening moments when you sort of like used AI and like realized what it could do for you as a manager and a leader? Sure. So my first experience of doing this, I've always cared a lot about writing and communication. And when I think about the thing I have been able to do best for teams, especially if I'm working with more technical people, I do often think it is on the communication coaching side. And I think communication is one of those things that a lot of people can be a little suspicious, like, oh, I should spend a lot of time thinking about how to communicate it, because that somehow detracts from the merits of the work, right, as if it's an exercise in rhetoric and politics and influence.
Hilary GridleyBut so often it's just clarity, right? It's just being super clear and making sure that the person that you need something from understands what you need from them can quickly think about is this a good use of their time and can quickly unblock you or give you the information that they have that you don't have or whatever it is. And so I would see this a lot when I was working with teams when they had to communicate with executives and especially CEOs where they would spend all this time working on some project and then, you know, they had to change the plan. And so they would need to go to the CEO and let them know that the plan was going to change and just get the CEO to feel comfortable with the direction that they were going to be going. And what would happen is oftentimes they wouldn't communicate it very well. And so I would spend a lot of time coaching my team on how to communicate in a way that
Hilary Gridleyprevented that from happening. But I didn't think it was the best use of my time to edit emails for people and I also didn't think that it was a good experience for them to have to wait for me or like I didn't like this feeling that like everything has to go through me so I set out to say well what would happen if I could encode all of the things that I'm assessing when I'm you know, sending an email or doing this kind of executive communication. Could I encode that into a custom GPT so that anybody could upload something that they're working on, some email they're going to send to an executive and get feedback and not just any feedback, right? Not just like what would happen if you put it straight into chat GPT and asked.
Molly GrahamBut specifically, my feedback. Wait, this is work. So were you doing that yourself manually, or were you doing that? I just want to, for people that don't even know what a custom GPT is, we just talked through your process. Because by the way, this example is great. But just talk, explain just a little bit more what you actually did. Yes. So I basically just made a document that had two columns in it. And I pasted a bunch of examples in the two columns.
Hilary Gridleybased on whether I thought they were good or bad examples. Then I uploaded that document into regular, regular chat GPT and I said, what are the difference between these two columns? If you had to distill basically the things that I am doing when I'm editing people's work into clear criteria that I could use to evaluate work, what would those criteria would be?
Hilary GridleyAnd then we chatted about it and I said, I like this, I don't like this. Let's try to get this to five criteria. And it's like clarity, it's action orientation, it's tone, it's things like that. And a very clear view into what does success for each of those look like? Like what does passing look like? And write that out, define that. And then eventually I take that and I turn that into a prompt, basically, which is just a set of instructions that an AI can follow.
Hilary Gridleyput that into a custom GPT, which is just a way to interact with something like chat GPT. But with a set of instructions that you've written that it follows every time. And that you could share with your team, right? Exactly. Yes. So I'm telling it, assess this across the following five criteria and give it a score, whether it is passing or failing. And here's what passing looks like in my own words. This is my point of view that I'm encoding here.
Molly GrahamDid your team actually use it? Because I feel like we make these things, and we're like, everyone's going to love this. I mean, this happens without AI. Everyone's going to love this instruction manual I just built. Did you actually deliver this to your team? And they were like, oh, thank you. Yes, but with some nuance. This was my first tool that was successful. So I had made other tools. And I tell this to my students, too.
Hilary GridleyWhen you're building tools like this, when you're building tools that are meant to be an extension of how you offer coaching or support, it has to solve a problem for the person on your team. It can't solve your problem. And I think that's where a lot of things go wrong is if you're like, oh, my team's not strategic enough, I'm gonna make a tool that coaches them on strategy.
Hilary GridleyAnd then I'm going to tell them, hey, you have to use this tool to get strategy coached. They're going to be like buzz off, both because you're inventing process for them for no real reason and also because it's just kind of a weird thing to do. So I went to them and I started with one person who I thought would be kind of friendly to this idea. And I was like, use this tool and just tell me if this is helpful. No obligation. I just want to know if this is helpful.
Hilary GridleyYou know how annoying it is when you are doing work and all of a sudden your day gets blown up by some executive request. Before you respond to it, just use this and tell me if it helps you. And she came back immediately and was like, this is so helpful. Thank you. And so I think that's like, if you're thinking about how can I use AI in a way that helps my team, start from their perspective. Start from, what are the things that are frustrating about their job?
Hilary GridleyAnd this is just one example, which is a communication one, but there's so many. Start with anything that is a pain for them. And if you solve it, it's like product market fit for any product you're making. You have to have product market fit for the internal tools you're making for your team, too. Because if you're trying to force people to use it, it's just like you're just fighting gravity. Yeah. You're really validating some of the things I believe by what you're saying, because one of my beliefs, and we'll see if I'm right in 10 years, is that
Molly Grahamthe human side of this shit is just never going to change. Do you know what I mean? It's still humans using tools. And I don't know, maybe someday we'll be managing teams of entirely robots, but it's very hard to imagine. So just tell me, it sounds like you've had some experiences of it not working. As you think about, I loved your executive communication example, because that's a kind of pain that everyone feels. And it's like, where are these sort of tools and use cases best found other than just like paying from your team. Are there principles that you have when you think about like, what are the use cases where AI can really help me? Yes. So there's two that come to mind immediately for me. One of them is just where are places where the work going into it is not worth as much as what comes out of it. A heuristic I use is
Hilary GridleyFor whatever I'm doing, if getting 10 times better at that thing is going to make me 10 times more effective in my job, I actually don't want to automate that because I want to get as good at that thing as possible. What's an example of that? Like something where, yeah, what's an example of that? So I think one is a lot of people love to use AI for data analysis and synthesis. And I think some of that can be good.
Hilary GridleyBut I think synthesis of a lot of information is one of the most valuable processes that you can put your brain through in order to truly internalize whatever that information is, right? If you're a product manager, it is so different going and talking to a bunch of customers and then looking at all your notes and trying to kind of put buckets around what is the information that's relevant.
Hilary GridleyWhat are the insights here? And especially what are the non-obvious insights here? That is such a different experience even than reading a well synthesized report. But so often the synthesized reports you get are not well synthesized, right? They are lossy and you lose a lot of the really valuable information because the act of doing analysis, the act of making the report is only partially about the artifact at the end. So much of it is about like what it does to your brain to get to that point.
Hilary GridleyAnd so if you are, for example, a product manager, your ability to have a conversation from which you pull out an insight and are able to sort out the noise from the actual double click, this is super important, is one of the most important skills that you can have. This is true for many jobs, right? Anything where you have to make strategic decisions. And so if you start outsourcing that and saying, oh, good news, I don't have to read.
Hilary Gridleycustomer interviews anymore, or I don't even have to do them because I have a robot that sends out these surveys, writes the survey, sends it, collects it, analyzes it, and just feeds me reports. Like you are robbing your own cognitive ability there. And so there are things like that where it's like, I think there are ways to use AI to extend your capabilities, which I can talk about, but I'm very cautious about it. Whereas there are plenty of other things like, you know, formatting slides is not something that I necessarily think you need to put as much time as I have lost in my life to formatting slides. I mean, yes and no, there is value in getting an intuition for visual communication, but you don't need to put the same amount of work in every single time you do it.
Molly Grahamdo you have an easy list or just a couple of other examples of something that actually feels very human but that AI has actually been wildly helpful with? Just give me one or two other examples that surprised you, how effective AI was at helping you with it. I've said that I'm careful about using it in situations where you're still low on the learning curve.
Hilary GridleyBut I actually think it can be tremendously helpful at teaching people how to do things, and especially at sort of hand-holding people through a process. And so an example of that is as a product person, a lot of what I'm thinking about is, you know, I have some hypothesis that our product would be better in this way, and maybe I'm right, maybe I'm not. And so I need to figure out how to validate or invalidate that hypothesis in the cheapest and fastest way possible.
Hilary GridleyAnd when you work on a product team, a lot of people come to you with their ideas, but there are many great ideas. How do you decide if this is better than any other idea? Well, the first thing you need to think about is, like, what assumptions am I making that would have to be true in order for this product to be successful, right? And then you can kind of isolate which of those are the riskiest assumptions. And then you can think about, all right, is there some way that we could design a small experiment that would test that and get us some data?
Hilary Gridleyto help us see if this is actually useful, right? And maybe it's just making a prototype that we deploy to 40 people internally and just see how many of them end up actually using it. But that's a process that like in my head, I'm just kind of like going through that is maybe not obvious to everybody. And so I made, again, a custom GPT, which is just, it's so easy to make a custom GPT. You literally just write instructions in English, plain English.
Hilary Gridleydo this, do this, do this. And then the AI follows those instructions. So I made one that had the instructions for walking people through that, where people would input an example of a feature idea they came up with. And then the AI would say, okay, the first thing we're going to do is unpack the main assumptions that would need to be true for this feature to be successful. And then it would give a couple ideas and it would sort of go back and forth with the person doing this to eventually lead them to Rather than coming to me with a feature idea, they're coming to me with data. They're coming to me and saying, hey, I ran this experiment and here's what I learned. That's the kind of thing that I can then take to my team, my stakeholders, and say, hey, we need to move forward with this. That's a really cool example. I want to ask you because.
Molly GrahamListen, one of my beliefs is that there's probably more bad managers in the world than there are good managers. I don't know if you agree with that. Okay. And part of what I hear you saying as you're talking is that to some extent using these tools amplifies your strengths. Do you think there's a world in which AI is making Better managers or are we just kind of amplifying people that are already good and already not so good? Oh good question. I think first like I talk about the you know this in theory the idea of I'm going to take what's in my head and encode that into a Custom GPT so that other people can use it technically that's incredibly easy to do. It's you're just typing sentences on a keyboard. Yeah It's actually very hard
Hilary Gridleyto figure out to get to that level of clarity in your own head around what is the process I follow here? What does good look like here? Like how do I think about what good work is and how we get there? And so I tell people all the time, like, even if you stop at the step of just trying to, you know, write out how you would walk somebody through a process to teach them how to do what you do, or stop at the step of write out the criteria for what good work looks like or what you care about, even just that would make you better than 99% of the managers out there. Like you get so much clarity in the process of trying to articulate what good looks like that makes you a good manager. And I feel like that for everything I've done, where I never used to think this much about
Hilary Gridleylike, how would I explain how to do my job to another person? Or like, how would I explain what I think, you know, a good writing is or what good product design is or any of those things? And merely the fact that I am better positioned to explain those than I used to be, like, in theory, that's me, right? That's still my point of view. But I never could have gotten there without the help of AI. That's super interesting. So it's basically caused you to have to be almost like,
Molly Grahamto be much better at making what is implicit, explicit. Things that actually could be defined as taste or judgment, you're actually having to write down criteria for? Is that actually what you would say? Definitely. And it's a challenge. And it's a fun challenge. And it is part of why I was initially very skeptical about AI. When I would hear about these AI writing tools, I was like, ugh.
Hilary GridleyNever, never in a million years would I touch those. For reasons including, I'm like, oh, you know, what I, what I do is so, it has such a je ne sais quoi. Like I couldn't possibly like, you know, articulate the principles that if you can match those principles, you can do good work. And I feel like it has been a humbling experience for me to recognize that like, no, you can, you can find ways to define good.
Hilary GridleyIn anything that you do and you should find ways to define good in anything you do If you care about somebody who is like able to help other people do good work And so it is yeah, I think it's been a really interesting process in my own realization along the way of Both the value of doing that type of work and also the fact that it is like Yeah, if it seems impossible for you to do, if it seems impossible for you to explain to someone else what good looks like in your domain, in your work, you probably haven't thought about it enough. As a manager, at least, because you should be able to get other people to that level. Yeah. You recently wrote about the fact that there's been a big shift in the last year that managers that you work with and that you sort of survey.
Hilary Gridleyhave gone from saying that their biggest problem was getting their team to use AI. Now, they're saying that the biggest problem is getting people to stop using AI badly. Will you just explain that for folks like that shift and the trend that you're seeing? Yeah. When I started teaching about AI and management, it was early 2025. The number one question that I was getting was, how do I get my team to adopt these tools?
Hilary GridleyAnd so a lot of the pain was, you know, people are resistant or they're busy or they're stuck in their ways, a million different reasons. But they just could not get people to use the tools. That's not really the case anymore. I mean, maybe in some places. But what I'm hearing way more is like, oh no, everyone started using these tools. But nobody was like, everyone is using different tools. They're using them in different ways.
Molly GrahamAnd we're all drowning in slop docs. Like I just get sent these 20 page documents that say absolutely nothing. And it's just like nobody's reading them. It's not clear who's writing them. And it's just creating chaos and a lot of companies right now. Like what do you think is sort of what I would call lazy AI use? But like what is what do you think is creating all that what you called slop?
Hilary GridleyBut it's garbage and garbage out right like I like to say that the AI sort of it shows you what's going on inside a person's brain right and it is an amplifier and if you are doing really thoughtful work the AI can be an amazing amplifier for You know getting that thoughtfulness out at a bigger scale, but if you're just like Tapping a button and going in and saying oh, you know, we need a Q3 strategy like hey Claude write a Q3 strategy for me That's what's going to be slopped. Like to me, it's like there is no thoughtful input. And so it's just taking nothing and then turning that into 20 pages. Yeah. Well, and I think you said somewhere that.
Molly GrahamBecause, by the way, this is, I think, one of the most interesting and complicated things that's happening right now. It's everybody's like, I'm using AI. And it's like, you're using AI to produce shitty results that actually make everybody else's job harder. People are talking about attacks on the person that you're sending something to. I think the other thing that I'm seeing a lot that people are talking about inside the communities that I lead is So you give someone feedback on a document and they almost don't take accountability for it. They say, oh, but Claude wrote that or but chat you wrote that So almost like as if they had a bad intern, you know what I mean, but they're they're not taking accountability for their own work So yeah, I'm curious like you said somewhere that like you can't solve this Problem by teaching people tools you have to teach people how to think like
Molly GrahamFor all the managers out there that are struggling with this. What does that actually look like and and is it I mean a is it possible? But like how do you actually how do you teach people how to think and how to sort of like not produce slop? Yeah, so I think that you know There's kind of two approaches to this one is you just hold the line on what the outcome is and like let people figure out how to get there And the other one is you kind of handhold people through the process of getting
Hilary Gridleyunderstanding how to do that work and I think both can work in different scenarios where one of them is the first one is sort of the more hard-ass like somebody puts something on your desk and you say like this is not acceptable and I will not read it until I read the first three sentences and I am not just like this is immediately obviously chat GPT written and by the way on that one like I think a lot of managers struggle because they say, oh, you know, I was pushing my team to use these tools and now they're using them. And it feels like this awful monkey paw wish where I got what I wanted, but in a horrible sinister way. And then you feel like you can't chastise them for using the tools because you're the one who made them use the tools. And to that, I just say like the answer is just, it's not done, right? It's not, hey, you did something wrong by using Claude. It's just, okay, great. You did the first step and now you have to do the work.
Hilary GridleyAnd so I give that just as people who are looking for a script of things they can say. If you're ever like, how do I call someone out on using Claude? Don't necessarily tell them they were wrong to do it. Just be like, oh, this is a great start. But for me to feel like this is acceptable work, it needs to not feel AI generated because that signals low effort. So go ahead and take another pass on it. So that's one way. It's just hold the line on the outcome.
Hilary GridleyI think the other way is just, you have to show people. And so I do a lot of demos. I think demoing, it's like, A, it's great for you as the person doing the demo, because it forces, again, it forces clarity in your own mind to get to a point where you can teach it to someone else. But it also is so, so, so helpful to see how other people use these tools, because it's not intuitive to a lot of people. If you're somebody it's intuitive for, like that's great. And so you might struggle where you're like, why can't these other people just figure it out?
Hilary GridleyBut I think a lot of people really struggle with it. And so in team meetings, I will put up my computer and I will say, let me show you this problem that I was dealing with this week and how I solved it using AI or where I brought AI in and just let people watch. And I hear time and time again that my team loved it. I do that in my course. People love it. So I encourage you that. If there's something you know how to do well, just show people in one-on-ones. If someone comes to me with a problem, sometimes I would say, Can I show you how I would approach trying to solve this problem with AI? And then like the kind of pair programming concept of letting people work together on things. So if one person on your team seems like they're really good at doing this, telling them like, hey, can you help this other person and walk them through how you might solve this problem? And really positioning it as like, this is a leadership opportunity for people who are motivated to get good at this because you are just like,
Hilary Gridleyyou know giving heaps of admiration and reward to this behavior and that's what is going to like motivate people to do more of it. Yeah I like that a lot because I think you know there's sort of a common management thing about like you can punish the behavior that you don't like but you much more effectively typically is like
Molly Grahamrewarding the behavior that's actually producing the results that you want. And I think part of what I hear you saying is like, the more you can hold up good examples of like, this is great. Here's why it's great. Here's how it was created and help people see what good looks like. That's one of the themes here. The more they're gonna then be able to think, okay, how do I do that? Okay, so let's, just as a closing point, let's imagine I'm a manager that has maybe used AI a little, like played around with it or used it to help some of my own work, but certainly not started to think about how to use it with my team. Where would you start or what would you push someone to think about in terms of what use cases are a great way to get off the ground or just what advice would you give them? I think the most important thing is just you need to use AI a little bit every single day.
Hilary GridleyIf you want a more structured way to do this, I have a free program that's called Couch2 5K for AI, and it's available for free at couch25k.ai. It has structured exercises. They really take two minutes, some of them take a little longer, and you do them every day for a month, and it takes you from chatting with AI, asking it questions, to actually building with it and building things that help you do your job better.
Hilary Gridleyautomating parts of your work, kind of having it as a chief of staff that just helps you do the best job that you possibly can, teaches you how to think about it, how to break down tasks, all of that. But I think there are plenty of ways to do this. I think the most important thing is just that there is often an activation energy hump of just sitting down and doing it. And I think a lot of people think that they need to carve out a bunch of time or take a course or whatever it is. And it's just sit down.
Molly Grahamand try to do something that seems a little bit too hard every single day. Love it. Awesome. Well, Hillary, thank you so much. This was really fun. I really loved learning from you. Thank you. Thank you for having me. That was such an interesting conversation. It really reinforced some things that I already believe, but I learned a lot too. So like one of the things that it really underscored for me is that so much of what you need to be good at, to be a great manager and leader is what you need to work well with AI. To some extent that it amplifies things we're good at and we're bad at. In all my work, I would say one of the things that a lot of leaders are really bad at and honestly under invest in is clarity and communication. We think that because it's in our head, everybody understands it and it's so easy to forget that the people that work for you
Molly Grahamor somewhere else. They're on sometimes a different planet. Sometimes they're just on a different part of the same planet. But how do you bring people with you? How do you actually help them understand all the context that you have, all the decisions that have been made? That is hard regardless of AI. It's something that I spend huge amounts of time working with leaders on. And part of what I heard Hillary say that was so interesting is that working with AI can make you better at your job because you actually have to explain yourself you have to take these things that are implicit in your head and make them explicit like her example around.
Molly GrahamWhat does good executive communication look like? That's something that I think a lot of people have experienced on both sides, right? Like, oh, I know how to send an email to my boss and get them to agree to something. But I see people fail at it all the time. Or if you're leading a team, I know how to convince the CEO or the board of something. But when my team does it, it's like, uh-oh. But have you ever stopped to say?
Molly GrahamCan I explain to someone? Can I teach them what good looks like? How do I actually explain that, not just in feedback, right, on a specific presentation, but in principles? In actual criteria that say good looks like this, like Hilary's point about it's not A, B, C in terms of grades, it's pass, fail. Like, what does good look like? What's above the bar? Challenging yourself?
Molly Grahamto teach others makes you have to be more clear. That's the use case to start with, and I loved that. I hope it was helpful to you. I'll see you all next week. Constanza Gallardo is the executive producer for Pushkin. Special thanks to Roxanne Hilash, Valentina Bohanini, Laini Lat, Tansika Sungmanivong, and Ashley Murphy. If you like the show and want more, come join the discussion on my sub-stack lessons. I'm Molly Graham. Thanks for listening.