Ops Cast
Ops Cast, by MarketingOps.com, is a podcast for Marketing Operations Pros by Marketing Ops Pros. Hosted by Michael Hartmann, Mike Rizzo & Naomi Liu
Ops Cast
The AI Gold Rush Problem: Big Investment, Unclear ROI with Naomi Liu and Mike Rizzo
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
Text us your thoughts on the episode or the show!
Welcome to another episode of Ops Cast by MarketingOps.com, powered by The MO Pros. Host Michael Hartmann is joined by co-hosts Mike Rizzo and Naomi Liu for a candid, no-guest conversation about one of the biggest questions in operations right now, which is what are we actually getting from AI?
With massive funding announcements, rapid product releases, and constant noise around AI, it is easy to assume everyone is seeing results. But when you look closer, most teams are still struggling to measure real impact beyond surface-level efficiency gains.
In this episode, we discussed the gap between hype and reality, exploring why ROI is so difficult to quantify, where AI is genuinely useful today, and the expectations that users have for what the technology can actually deliver.
In this episode, you will learn:
1. What OpenAI’s massive funding signals for the future of AI and operations
2. Why most teams cannot clearly measure ROI from AI initiatives
3. The difference between time savings and real revenue impact
4. Hidden costs of AI tools that make ROI harder to track
5. Why AI adoption often fails without proper change management
6. The belief gap, skill gap, and expectation gap are slowing teams down
7. How fear and uncertainty are shaping AI adoption inside organizations
8. Why the “AI gold rush” does not guarantee real business value
9. What AI agents can and cannot do without human oversight
10. Why strong operators become more valuable in an AI-driven world
This episode challenges the assumption that AI automatically drives value and offers a more grounded perspective on how operators should think about adoption, measurement, and long-term impact.
Episode Brought to You By MO Pros
The #1 Community for Marketing Operations Professionals
MarketingOps.com is curating the GTM Ops Track at Demand & Expand (May 19-20, San Francisco) - the premier B2B marketing event featuring 600+ practitioners sharing real solutions to real problems. Use code MOPS20 for 20% off tickets, or get 35-50% off as a MarketingOps.com member. Learn more at demandandexpand.com.
Quarterly Check In And Setup
Michael HartmannHello everyone, welcome to another episode of Opscast brought to you by well, you know who, marketingops.com and all the MoPros out there. This is gonna be an interesting one. Uh we see this is a we've got special guests, like my two co-hosts, Amy Lou, Mike Rizzo. We don't get to do this right often. I always feel very special.
Mike RizzoIt's uh special. You're our you're you are special, yeah. That's the best way to say that.
Naomi LiuTell me more.
Mike RizzoTell me more. Tell me how special I am today. Yeah, I don't know I want to feel special today. That's what I want to feel.
Michael HartmannYeah.
Mike RizzoNo, I was thinking about it.
Michael HartmannFor all you listeners, you're special, just so you're watchers, you know.
Mike RizzoFor watchers, right, because we do the video now.
Michael HartmannYeah. Right. Um, now I was thinking about like I I I think I think by by just happenstance not really planned, we end up doing this about once a quarter. It feels like, or once every six months. I think it would be good to like let's do this like that, like make sure we do it.
Mike RizzoYeah, we need to be a little bit more intentional with that. The use of the three amigos time on the pod and just reflecting on things. I agree.
Naomi LiuI agree.
Michael HartmannWe we need to have some of the uh you know, three amigos, the what was it was the was the movie three amigos, right?
Mike RizzoI think so. I think there's also a tequila. We could do that too, right? We could do that too.
OpenAI Funding Numbers That Stun
Michael HartmannSo so we're recording this the first day of quarter two, so that would be April Fool's Day, but we're not gonna we have to share no jokes to share. I only know a handful of really bad dad jokes anyway, so likewise. Yeah. Um, but a couple days ago we saw the announcement about open AI getting massive funding. Like, I don't know, yeah, like crazy. And then like you had recently posted some stuff about asking people if they wanted to hear about you know what others are getting in terms of ROI from AI initiatives, and you thought we could start there, like which I guess those two things kind of coming together, it's like it looked like there's a massive interest in seeing like what what are other people getting out of AI, which makes me think, are others not getting that? Are they just not sure how to measure it?
Mike RizzoYeah, yeah, for sure. Yeah, let's start. Let's start with the news for those of you who may have missed it. Uh OpenAI announced an incredible amount of funding, I don't think. I honestly don't know if it's ever been as high. Uh it's crazy, as high as as high as it has been for these folks. So they they announced 122 billion raised in their round on an 852 billion with a B folks, yeah uh valuation. And um and so the I I only grabbed the first part of the message to send it to a few of my my friends, and I was just like, this is insanity. And and the the opening of the post from uh I think their CFO or whoever posted on LinkedIn, yeah, said hey OpenAI was the fastest technology platform to reach 10 million users, the fastest to a hundred million users, and soon the fastest to one billion weekly, weekly folks active users, a billion weekly active users. That's insanity. And then they said within a year of launching Chat GPT, we reached one billion dollars in revenue. And by the end of 2024, they were generating a billion per quarter, and they are currently, as of the post that went live yesterday, which would have been the 31st of March of 26, they are now generating 2 billion in revenue per month.
Michael HartmannThat's insane, crazy, and valuation is uh approaching a trillion dollars.
Mike RizzoLike, I mean, I I was like my initial gut response to that was to try to figure out like as a percentage of GDP of the just US, like what where are they at relative? Like, this is nuts. Like, that's the scale of revenue that these folks are having, and then you know what, like I said this to somebody else yesterday or earlier today, I don't know, too. And they're like, I think that the person's response was like, we're all screwed. I was like, wait, what does that mean? What do you mean by that? Why why are we all screwed? Um, but their burn rate is insane. Like, I don't know exactly what it's all on, but I I know that they're um I guess like one of my colleagues was saying that um between 26, the year of 2026 to the year of 2029, their expected burn is to be over a hundred billion dollars. So like that's an insane, like in three years they're gonna spend a hundred billion dollars um on whatever infrastructure, people, marketing. Like I'm sure the tech itself costs pretty decent amounts of money. The compute power of AI is like getting better, but it's still a lot.
Burn Rate And Building Data Centers
Michael HartmannWell, I mean, so it's interesting. I I I have a friend who uh uh works in HR at a company that builds out data centers. And he said I can't remember the number of people he said, but they have to hire they're gonna have to hire an extraordinary number of people over the next uh few years to help. And it's like what's interesting is it's it's uh it's jobs like electricians, plumbers, uh, construction workers, right? It's not high tech we would think, right? Because that's what they have to do. They have to build the the infrastructure and get it set up and running and all that. Um which is like now it makes sense, but like I it makes me think like there's this capital that's had nowhere else to go.
Mike RizzoWell, that was the yeah, that was the other thing that like not not that like I'm you know I don't know, but like I'm not proposing that there's just like this secret money that sits somewhere or whatever, but it's just it's it's a little alarming. Yeah, yeah, yeah, exactly. I don't I don't mean to insinuate anything like that, but it is just like eye-opening when you look at it from like sort of this macro point of view, like holy cow, there's somehow that many billions of dollars just like able to be pulled together and invested just like somewhere out into the world that is accessible, you know. Like 122 billion bucks.
Naomi LiuI wonder how they're gonna utilize that money, like where they're gonna where they're gonna put infrastructure, right?
Mike RizzoYeah, yeah. I I imagine it'll be probably data centers and server farms and all that kind of stuff, and then I'm sure some asinine amount of marketing spend and that kind of stuff too, but they have to pay for a lot of electricity, yeah.
Naomi LiuWell, infrastructure is their bottleneck, right? And that's just yeah something that they that takes a lot of money, so yeah.
Mike RizzoBut it's crazy though. It's just yeah, but it's crazy. Like there's 122 billion dollars out there that they were able to find from all these wherever companies, investment funds, whatever. I was like, you know, I'll just take like 0.0001% of that, please. Yeah, I'm still pretty sure that's still a decent amount of money. Yeah. I didn't do the math on it. Some math whiz is like, no, that's not that no, you mean like 0.001. Got it. Yeah. Thanks.
Naomi LiuBut I also feel like having that amount of investment and that amount of money, it doesn't like on one hand, it like validates that yes, AI is here to stay, right? It's not just this, you know, novelty product that people are really into right now that's just gonna disappear. It's like mass habit, right? Um, but I do think that it also intensifies or like makes scrutiny much more apparent, right? Because the bigger this company gets, the more scrutiny it's gonna face around things like competition, security, you know, data breaches, yeah, the thing that happened with anthropic, right? Like, you know, dependence on server farms, compute stack, compute providers, things like that, right? So like I don't know, I just I think it's like a two a double-edged sword, right?
Michael HartmannWell, and I think especially validates it, but also between the three of us, right? When we were talking chatting in Slack about this, so like my reaction was like, and this is a company that started as open source, like the intent was to make it available to everybody. And here they are. So it's like, you know, I don't know what that says. I I do think that's gonna force more scrutiny on them too. Yeah.
How ChatGPT Became The Front Door
Mike RizzoYeah. Yeah, I think there's definitely some eyeballs that need to be paying attention to them. I think if I'm the other products in the market that you know, I I find this like fascinating as we as we sort of like transition so some of this conversation into the poll that you mentioned at the top of the top of the episode. Um here here's open AI like raising all this money. If you if you were if you go, there's a company called Augment um that does some. You guys are like, where are you going right now? So there's this company called Augment that does training or whatever. They they like help you learn from experts in the field. Okay. Um and one of the instructors is uh, I believe it's actually the one of the original like founders uh or executives of OpenAI. And um, there's a brief backstory that he gives of like how the Chat GPT product came to market. And so um if I could if I could truncate it a little bit, and someone could fact check me on this if they go find it, um, but I'm pretty sure I remember this accurately. And and from what I recall from the lesson that he taught in the backstory about ChatGPT is that it actually was never intended to be the initial app. What they were doing is they were struggling to get these companies to adopt AI. So they were saying, hey, we have these capabilities for you. We want you to ingest them into your products, we want you to start using our AI to enable your companies to do more, whatever it is, whether you're a software company or whatever. And they weren't getting the adoption and they went and turned on this thing that was more like, hey, here's this self-service way to sort of interact with the AI, right? With our with our um LLM.
Michael HartmannYeah.
Mike RizzoAnd that is what was the it was like it was this like almost accidental catalyst that was never intended to be a like for the general public. Like they they had intended to build sort of behind the scenes and like go like work with these companies and be this infrastructure layer, right? And now, juxtaposition, like you know, fast forward a handful of years later, like the broader market starts adopting it, it forces the conversation across the board, including at businesses, and they're trying to establish these technology partnerships. I'm sure they have many of them. I've heard of these things happening, I don't know where. And you look at like what our community, just from what I've observed and the conversations that I've had, both with like you two and with others in the community, there's this like really big shift from yeah, ChatGPT was like great, but cloud is like just run away with so much of our audience's like attention. And I've personally like shifted all of my workflow to be cloud-based at this point. And yet here's OpenAI saying, yeah, we just raised you know, an asinine amount of money, and and most of our market, our practitioners are like signaling, no, no, no, Claude is the place where I'm spending my time right now. And so if I'm Claude looking at that capital raise, I'm like, either I'm worried or I'm like, oh yeah, we're about to announce something very similar.
Michael HartmannIt feels like they keep leap-rogging each other.
Mike RizzoYeah. Yeah.
Naomi LiuRight.
The ROI Question Everyone Asks
Mike RizzoAnd then you get a but I do think it's a right behind. Yeah, but I think it also sort of begs the question like, you know, who who are your end consumers, right? If OpenAI's sort of like initial foray into the market was meant to be more on the B2B transaction side and not the B2C sort of piece, um, then then perhaps like that's really where a lot of this investment is going to end up going, is like back into that direction. And I and I don't know who Cloud's sort of core customers are, but we're seeing uh a big shift from them to be like, hey, like get your enterprise on here and or start orchestrating across your team, not just the end user, but it'll just be like fascinating to see what happens, which is part of the reason why I asked the question that I did on LinkedIn, which was all about getting ROI out of your AI. Like, is anybody getting it? And would you like to see you know what others are doing? Like, I don't know. Naomi, like, I think I it was actually prompted by Naomi's question to me. She was like, Do you I feel like I remember you and I were talking about this? You were like, hey, I feel like there's a bunch of hype that I see, but I like, does anybody actually get ROI out of this stuff? I was like, I don't know, let's see what people say. Like, and the result was there were two people that wanted to show off what they were getting out of the soft, soft like measurement too, right?
Naomi LiuLike time saved, you know, and you put a how you put dollar value on your time, right? And it's just kind of like an extension of your day-to-day now, you know, but like in terms of like actual ROI dollars, I'm curious what people are doing.
Mike RizzoYeah, right.
Naomi LiuLike great if you know you're saving 30 minutes per email that you're building in Marketo, or like you're shaving down some time, pulling together reports for senior leadership. But like you're accelerating lead scoring and routing. Exactly. But like actual ROI around revenue. I'm curious about that. I want to see that.
Mike RizzoYeah. And I think it is part of your curiosity, other is it self-driven? Is it your own sort of teams or your peers are asking you similar questions? Like where is that curiosity?
Hidden AI Costs And Messy Models
Naomi LiuI think that's just a I think it's a bit of all of it, right? I think a lot of us who work in this industry, we will often get, you know, a lot of the tools that you know you have in your tech stack have now at this point AI components to them, right? Um, there are tools that are all AI and you can't, you just can't escape it, right? Even and even if you wanted to. So part of that is okay, so if I'm adopting something into the organization or I'm adopting it into my personal workflow, how does that help me either by saving time or can I prove out that it's actually giving back some kind of ROI in terms of real actual hard dollars to the business? Um, and yeah, like part of it to answer your question, part of that is personal curiosity, because that's how I like to learn is from other people, right? That's why things like mops are great and things like other conferences are great because you get to see what other people are doing. So you can potentially have takeaways to take back into your own, you know, use case. Um but also just, you know, wanting to be on top of what other people are doing, because if we get that question, then you kind of want to be known. I think people who work in this at work in our industry, like we tend to generally be regarded as the subject matter experts in all things tech and digital. So we kind of want to be able to speak eloquently about these things and these topics when it changes constantly all the time. So yeah.
Michael HartmannLike, do you expect to get um and it's different because it feels like it feel felt like what sick it feels like it was only six months ago where clay, like everybody was talking about clay, right? Maybe it was nine months ago, but it wasn't that long ago, and it I just don't hear about it anymore. So um, but I like I played around with it and I've played around with some other like I never used N8N, that was big one. I've played around with relay. Um, and what I figured out was like, oh, there's these hidden costs that are part of it too, right? All those calls to the LLMs or you know, uh AI platforms have these costs, and it's the pricing was pretty opaque, right? I never knew what it was gonna cost for any particular call. And and I think that's part of what's making it hard. There's like so many like the fragmentation in Martec has been pretty big for a long time, and now you throw all these things in there, it's like people are creating stuff all over the place that pricing's all over, and you it's really hard to quantify like how much are you actually spending on it, and then it makes it really hard to go like okay, well, then how do you go, like, okay, we spent X amount uh last quarter, last month, whatever. How do I know? Yeah, do I need to get the benefit of that in the short same time horizon, right? Even if our sales cycle of a big company is 12 months, 18 months. Yeah, like it's like, yeah, how do you like I don't know how you come up with the model for that? And I mean, for like working with a big company right now, like they're really behind using AI for I think they would call it time dividend. I don't know how you measure that though, right? Because the level of use by any one person across the like there are gonna be some people who are like off the charts, right? They're using it every day, all the time. I'm gonna come up with creative stuff, and other people who are kind of in and out, and then some people are just like well, that's all you know, it's all hype, right? It's not gonna really affect what I'm doing. And uh so like it's really I think it's a challenge, right? So I think it's probably why in your poll, like what was it? Well over half of the people were like, Yes, I want to know.
AI Agents That Cut Ticket Noise
Mike RizzoYeah, if people are getting ROI because like I Yeah, they're all like, Yeah, I definitely want to see what people are doing. And the second option on the poll for those of you that are sort of listening and watching was was basically like, Yes, I want to see, but I'm also willing to demo. And there were just two people that said that they were willing to sort of show it off. Um and and while the question wasn't directly like, are you willing to show it off? Um I think those who are excited and confident about it uh would have like sort of like selected that. And there's there's two individuals, two of whom both of whom are in our community, and I've heard and watched them talk about you know the things that they're doing. Um, so it's it wasn't surprising to me that they were like willing to show it off. But I I think it's very telling of the situation that we're in right now, which is just echoing everything that that you just suggested, Hartman and and you as well, Naomi, is just that like how do you measure this stuff? It's really hard. The the hidden costs of all these things, the little mini products that you're building, like all of them have these like intricacies that that are just fundamentally different in an already like uh fragmented landscape of technology. Um and I think for me, the the latest observation uh that I've sort of like been trying trying to pay attention to, at least, and is really just it boils down to like this efficiency gain thing, right? I think for years we've been tasked as marketing operations professionals in general with the idea of like, how do you measure the investment of a Marketo or a HubSpot or whatever? How is that impacting our ability to generate revenue? Um, and there's been threads about this in Slack before. There's been conversations, probably on this very podcast, if I recall, about like literally doing the math around how much time does it take to build an email, send an email, and what is the cost per email? And then does that email generate a lead or whatever? Right. Like there's formulas that people have like built out for themselves to try to say, hey, like By using this tool, we've been able to drive some level of dollars. Um, and like that's kind of our natural instinct as like like people who manage this tech, but also the the folks that we report into, they're sort of always trying to measure it that way.
Michael HartmannYeah.
Belief Skill Expectation Fear Gaps
Mike RizzoAnd I think while it's a worthwhile venture to pursue that level of measurement of any piece of technology you invest in, I do think that it goes without saying that there are many that you just can't do that with, right? Like, um what is the ROI of my phone bill? If every time I pick up the phone and I call someone that is a potential prospect, like is it that by paying for Verizon versus ATT that like I made the right choice? Like there's just things that like there are the costs of doing business, and some aspects of your investments just sort of fall into that category. Um, and I think AI is for me lately has just been like, yeah, this is just a really good enablement solution to like let people do things way more effectively than they used to. And in some cases, you're gonna go build out a very hyper-specific product use case that unlocks your ability to do something new or in a novel way, the same thing in a novel way that is that is just better than it was before. And and if that costs you an extra hundred bucks a month, like great. But it's like the same motion, just better. Um, and but a lot of it is like what what Justin Norris posted on LinkedIn the other day was like, hey, I am forcing my team to prove that they interacted with our agent that we built for them, yeah, to stop asking us like, or to stop putting tickets in our queue that they could find the answers to. And they have to literally drop the link. This is a like this is a great. If if all you did was stop listening after this part of the episode, this is probably the best takeaway. Justin does this post, he says, I built a system, it's an AI agent, it knows all these things about our business. If someone wants to open a ticket with us, they have to prove to me that they asked the AI first by sharing the link of the conversation. Because if they didn't, then I'd I'd just reject the ticket. And the result of that was a 33% reduction in effectively what he calls like paper cuts, like wasted time tickets that could be solved with a system where knowledge already exists. You just need to spend time to go look it up. And I was like, wow, that's amazing. My first thought was Justin's working himself out of a job. I was like, uh oh, dude, don't get rid of all the tickets.
Michael HartmannI don't think that's true though.
Mike RizzoNo, it's not. My second thought quickly following that was like, that's not true. In fact, it's actually unlocking him and his peep his team's time uh to go spend more energy on things that really move the needle for the business, right? Which is uh which is why I really appreciated his comment about the tickets being paper cuts. Like they're painful little moments that you just shouldn't have to deal with.
Michael HartmannWhat so what really caught my eye on that is like there's this this may be part of what I think people struggle with AI. I'd love to do your take, mammy, because I don't know. I mean, I guess you've implemented some AI tools where you are, especially with your broader scope now. Um, is that like I think people have thought, well, there's not really we don't really need to do much for change management, right? And I remember doing some research on change management like 12 months ago, and the best paper I found about it was written like a Harvard Business Review article that was written originally like I think the 70s, maybe early 80s, because it's still like it still applies because it was all about human nature, right? Resisting change and you need to communicate and then you need to reinforce it, right? So to me, what Justin did is like people always I get people all the time. I'm like, how do we get people to do this new behavior? I'm like if you they try to do the old behavior, you tell them go do the new behavior, right? It's not really that hard, except for then you feel bad. If you're the kind of person who likes to solve problems and help people and like the problems really with you, not with the people, right? They're gonna do what is most effective for them. And if you enable it, then who's that who's that with? But yeah, have you have you gone through that, Naomi, with like AI tools internally? Have you had struggles with that?
Naomi LiuYeah, I think um, and I actually was having a conversation with this uh about this with a friend the other day when we're catching up about similar things around AI in our companies, and you know, and just in general, right? People that we talk to, um, I think that you can group it into like three core gaps, right? Belief gap, skill gap, expectation gap, right? So belief gap. Uh, you know, people think AI is impressive, it's great, it's this like amazing new thing, but they don't actually believe that it will materially help them in their actual job, their workflow, or the company that they work for, right? Second, skill gap, right? Uh, you know, I know what I don't know. And there's a lot about AI that I don't know. There's a lot that I do know, there's a lot that I don't know, and I there's the gap in between is huge, right? And I think even when people want to use AI, it's still like really surprisingly hard to eke out value, right? You need to be an amazing prompter, you need better process design, you need like really good data, you need to, you know, be very specific in how you're doing and how you're aligning something. Like just the other day, I was asking um AI to create this like image for me because I'm trying to like redo something in my house. And I I was asking, create this visual image because I just want to see what it looks like, right? And it was putting this one thing in the wrong place. And I said, no, put it on the other side. And it kept not doing that, putting it everywhere except that. I said, no. And I literally would like draw out a picture and then circle it and I would say, put it right here. And it still refused to do it. And in my, and I'm like, oh my God. And I'm like furiously typing. And I'm like, what is wrong with me? Like, why am I arguing with my computer about this? Like, put it on the left side. And then eventually I just gave up. And I'm it's like 12th attempt or no more, no more polite. Uh no more. And I'm just like, why are you not doing what I'm asking you to do? Right. And it said something like, I have really poor spatial awareness, so I can't understand your prompt. And I was like, What? Okay, you know, so anyways. Yeah. So I'm like, okay, is it me? Is it what's the skill gap here? Is it me or is it? I don't know. Anyways, and then the third expectation, right? So it's like, and this is an example of it, right? So I have this expectation that AI is gonna not read my mind, but pretty close. You know, I have this expectation that's just gonna do what I tell it to do, transform it, and then the payoff is gonna be great. I'm like, okay, yeah, that looks great. I can totally visualize what I want to do. And, you know, it just saved me so much time. But the reality of it is like you end up, it just ends up being like slower, messier, and just more frustrating experience. Right. And so I think you can take those three gaps and apply them to many scenarios. So, like, yeah, the belief, the skill, and the expectation part. I that's just kind of like how I see see things right now in organizations, in day-to-day life, in how people use AI. I don't know what you guys think about that.
Michael HartmannI I think I would add a fourth dimension, which is fear. Like, I think people are fear about what it means to their job, right? Or their whatever, right? Their agency. Um I think there's a lot of benefits of it. But it's it's interesting because you brought up that point where it doesn't, it feels like it's not it's sort of ignoring what you're asking it to do.
Naomi LiuI asked it to remove a chair and it added two more instead. I'm like, what am I what is like what am I missing here?
Mike RizzoSo so this is why it'd be no chairs in the picture. Zero chairs.
Gold Rush Shovels And Supply Chains
Michael HartmannSo um it's interesting. So this is the other part, like a risk part that I think and we were talking before we started recording about how I I think anecdotally, I think there are a lot of companies who thought, oh, we can get rid of marketing, we can get rid of these roles, and we can replace it with AI and agent, agentic AI and stuff, and that they're now quietly rehiring. I I think there's more of that happening than I than makes big news, and maybe it's just wishful thinking. But one of the things I've found that even though I spent a lot of time, and I still need to go try this with try stuff with Claude, I haven't switched over to spending time with that because like it would have I put a lot of invested a lot of time in training Chat GPT for me and what a lot of things I do. But even with that, like I find myself repeating, going like, hey, I told you don't do this, or I told you go do this, right? And it keeps it's sort of it still veers off. And what I think the the the the the risk part that I worry about, in addition to all the other ones, right, about privacy, yada, yada, yada, um, lack of control, is like just personal experience. If you're if you're relying on something like that to just work and you're not monitoring it, or it's really it can run in the background, like, oh, it's just gonna run 24-7, do all this. Like, I my take right now is like I would be really worried about that not working the way it intended. Like, we did all this, we got it right, and then it's it's like when you shoot a gun or an arrow or something like that, right? If you're off by a little bit at the beginning, it's gonna be way off when you get to the target. And it feels like that happens with AI stuff that I've personally experienced a lot.
Naomi LiuWell, that's that kind of I can't remember where uh it was on LinkedIn, someone had published something, but I can't remember who. And they had it, they had kind of like compared it to the gold rush, right? Like people who sold shovels during the gold rush, like you pay for the shovel, and then that was it. It was like good luck. And then if you struck gold or not, or went broke or whatever, it was like not their problem, you know. Like they there's an entire economy built on selling shovels in a gold rush where not everybody finds gold. So I'm done. I just thought like that, right?
Mike RizzoAnd me by I've often I've often uh reflected on that same sort of notion. Like when I, you know, I'll be on a walk and I'm like, I actually want to be the person that makes the special bolt to put that light up because there's lots of those lights here, and those bolts are really imperative to that light being installed. I don't care about the light, I care about the bolts. Yeah, you know, I think it's funny.
Why Humans Still Run The System
Michael HartmannIt's that reminds me. So like I remember back before internet was available on planes and I would travel a lot, sat next to a guy, we actually had to talk. And we actually talk, we and uh the whole we search and start chatting, and we he, I was like, What do you do? What do you do? And he's like, I sell food grade adhesive. And I was like, What? What do you mean? And basically, it's like if you get cereal or a candy bar or whatever, right?
Mike RizzoThere's adhesive that is used to steal the package, yeah.
Michael HartmannAnd I just like I don't know why, right? Very naively. I was like, that's just as part of whatever whoever comp whatever company produces the food i right, yeah, and it's not, and I was like, oh my god, there's all these things that are part of the economy, yeah. The supply chain, like pieces like there's all like have you heard about the the the SA i pencil? No, it's called eye pencil, yeah. So uh I don't have to I'd have to go find it, but I've heard about it multiple basically it's like somebody talks about like if you're using a pencil, right? A standard I don't have one here, I have a mechanical pencil, but you know, a wooden pencil, right? It's like you don't realize like all the things that went into producing that. If you don't like when you start thinking about it, like somebody had to go you go like go all the way back, right? Somebody had to go mine the metal for the little metal piece, somebody had to get the rubber, somebody had to get the wood, had to get the graphite, right? All that stuff, like all these things.
Mike RizzoYeah, yeah, yeah, totally. And totally different materials combine in a very unique way, right? To like create this thing. So fascinating.
Michael HartmannAnd then it comes together and you pay hardly anything for it, right?
Mike RizzoYeah, yeah. That's so crazy. Yeah, I don't know. I think I think that there's to kind of go back to what you're talking about, like people getting quietly hired back to these organizations. I think that there's probably going to continue to be more of that. Uh it doesn't dismiss the fact that AI does allow you to operate more efficiently with just one person. So perhaps what you have to do.
Michael HartmannI wouldn't assume it, yeah.
Mike RizzoRight. It it it it allows you to do that in some regard. It doesn't do it perfectly. Uh, will it do it perfectly one day? Maybe I don't, I don't know. But I think to to that end, it probably opens up this. I can run a little longer with just like two people instead of five or whatever. Um, but eventually there's like this um sort of plateau, right? There's only so much so much time in the day and so many so many things you can possibly be doing. Um I think it takes people to be able to make these things work really well. If I like I don't did I give the example on an episode previously of like the little coworker agent that I built? Did I share that with y'all?
Michael HartmannNo, it sounds vaguely familiar, but I don't I don't remember it.
Mike RizzoSo it might have just been you and me talking on the phone too. So that the the punchline, or I'll try to I'll try to be as as concise as I can uh on this on this example, but I think the context matters for for our listeners. Um so you know, today Cloud's got lots of capabilities. Uh people in marketing ops are often looking at the cloud code side of things, which is fascinating. I'm just not I don't have the bandwidth to be able to go look there. But what I did look at as this uh MCP connection, this the server connection to my HubSpot account. And I said, hey, you know what? We've got a lot of folks in our community that um I believe are interested in becoming members and and there's lots of value we can bring to them. And I just don't know how else to reach them. I don't have the time. In fact, we've never really tried before. And so let me let me like maybe go hire somebody, a person, to to like say, hey, let's try to let people know about what membership is. That was my plan. So I share this with my with my a peer of mine who runs another organization similar to ours. And uh, and his response to me was like, Why wouldn't you just make that an agent? Right? Like, why wouldn't an agent just do that for you? And I was like, Oh, okay, fine. He's like, you know, center your business around agents. I was like, okay, fine. So, all right, Claude, instead of writing the job description and all the steps in the workbook, the playbook for the person, I need you to pivot this to an agent. Does a nice job for that, creates a folder on my desktop. I point Claude co-work at the folder and I say, execute the job. So it hits up Hubspot, finds the 10 most likely candidates that look like they're interested in membership. It finds its own data point, didn't have to tell it which one it was. Uh, it was the right one. I was pleased by that. And uh it drafts 10 emails for me in my inbox, right? Personalized, very customized emails, like very customized emails. Like, no way anybody could do this in the short amount of time it didn't, let alone probably at all, right?
Michael HartmannRight.
Hiring Anxiety And What Changes
Mike RizzoUm and here's the thing, everybody like this is this is the part where Naomi, you and I were talking like recently. This is the part where everybody goes to LinkedIn and is like, look at that, look at that, I did it. I have mastered the world. I am God, right? Like this is like this is ROI. This is the part, yeah. Everybody goes and shares it right with the world. The reality is that was great. Thank you, Claude Covert, for doing that. It was about 80% correct. I probably still need to coach it. I could probably get it to 90, 95% correct to where I feel really good. And I could actually probably run this on a cron job or a daily schedule to have it do 10 emails for me every single morning. But the truth of the matter is that it is not gonna continue to self-optimize. So just take it a couple steps further, right? For all of you watching or listening to this, and for you, Naomi and Hartman, right? Like, I built this little product that is focused on membership sales, that I don't have an endpoint, and I could point it at things like, hey, uh, at the end of this, go back and look to see if anybody actually signed up. Like, I could give it some more data to try to do some of these things. But to then go beyond that and be like, hey, you know what? Should we try two touches, three touches, four touches instead of just one? Should we do something like all of the rest of the things that continue to optimize the product that I built is a person's job. And they need to guide it on the nuances of the things that are happening in the market, the things that are happening in our little business, the conversations that are happening inside of our community, and help point it in the right direction because it can't pick up on all of those cues. It can't possibly do that.
Michael HartmannRight.
Mike RizzoAnd this is where I was like, yeah, this is great. I'm a subject matter expert in my business. I built a little AI product, and now I need to hand this off to a human. So where I started is where I ended up, which is like, I actually need a person to do this thing. And I think that's what's going to happen is that you're gonna find these businesses that are realizing, oh, I can build these little tools to do things really well, but I still need someone to optimize them and make them more effective and efficient and better. Um, you know, whether it makes them as an individual better or solves for a KPI that we're pursuing. I think that's where we're going. And that's why people are going to get hired back, is ultimately understanding the business and the technology's capabilities.
Naomi LiuYeah.
Mike RizzoAnd that was the short version of the story.
Naomi LiuYeah.
Michael HartmannNo, it's it's interesting because I was at a uh an event at an engineering school last night. Um, and it was a networking thing for graduate students in in the engineering school to meet people in industry and and stuff. And um the it was interesting, the questions that came, there were some uh panel speakers uh and the questions that came from the audience, a lot of them were like you know, how are you changing how you hire engineers, especially for computer science, right? One person was at AWS, one was at a startup, uh, and is CTO. And it was really fascinating because like on the one hand, they were like, it's not really changing it. I still like the CTO guy was like, Yeah, I still look for attitude and aptitude combination, right? And somebody would fit their AWS one was a different like gigantic company. And it's like I guess I think that what this goes back to the fear, like I think these people are in graduate school, it's it's vested a lot of money or somebody did, right, to get them in there. They're like, what am I gonna do when I get out? Um, and I'm I guess I'm hopeful that there will be stuff, especially as a parent of you know, college students right now.
Pricing Transparency And Better Trials
Mike RizzoYeah. I think there will be. I do too. I think I think there will be. But I think it's gonna look a little different than it has in the past. It's not gonna be this like sort of I don't know, in some regards, I I I I can't say it with definitive like gumption or anything like that, but like I I do think it'll it won't feel as like myopic in in terms of like you know how to do like this particular thing. You you sort of like are almost forced to try to understand more in order to use the thing, the AI capabilities to their advantage, right? Like you're having to learn business and and the the nature of the market and the products and the things that they're saying because all of that context allows you to do more with the tool that we have access to nowadays.
Michael HartmannNow how to run an early early stage sales call. Right, right. Sorry, inside inside inside baseball days.
Mike RizzoWe'll spare you all the story. But if you're running an early stage sales team, let's just make sure that you you flip for this audience, flip the deck upside down because that is Naomi's claim to fame. You're muted. You're unmuted.
Naomi LiuNaomi, perfect timing for that. Sorry. Yes, present it backwards to me. Um I want to see the price first and what it integrates with, and then everything else after.
Mike RizzoYeah, yeah, yeah. What is the price? What does it integrate with? And let's go back. Now show me some of the capabilities. Okay, now show me who your customers are. Just start there. I don't care.
Michael HartmannI don't care about the rest. That's so funny. Yeah. Anyway, anyway.
Naomi LiuI wish I wish people would send, like, actually, that this is a thing. I challenge anyone who's listening, send a prospecting nurture email with your price to me. If you send me an email that's like, hey, our product costs this, are you can you will you join a call to learn more? I'll be like, yes. Tell me how much it costs, I will join a call.
Michael HartmannYeah. Yeah. Right? I it's funny because like whenever I like I've run web teams and as well and It drives me crazy that people are like, oh, we don't want to publish pricing. Our competitors will get it. I was like, they already made it. But it's not it's not published.
Naomi LiuThis is like you know, send it, send it as a direct email, like a one year one.
Michael HartmannBut I'm like, but competitors gonna go like competitors gonna get it. They already do, right? Yeah. Like every like I would never go buy tech right now without contacting people through the community or whatever, and go like, who's got experience with this? What are you paying? Because I've been burned before, like pre-community. Like I found out after the fact like we were getting screwed by a vendor. And and it's like, and it pisses me off. And yeah, if they were doing it like I don't like pisses me off that I let that happen, right? But I didn't have any other way to get that inside information, right? And now that's pretty much the default, it feels like.
Mike RizzoYeah, yeah.
Michael HartmannSo yeah, well, go ahead, send the email with your pricing.
Mike RizzoThere you go. Don't just for all the listeners, do the do the list pricing, right?
Michael HartmannList price, yeah.
Mike RizzoJust tell us like, hey, we generally sell for this range depending on a number of factors.
Michael HartmannYeah, hear the factors.
Mike RizzoWe can get on a call to discuss what those are. Yeah, okay. Sounds good.
Wrap Up And Guest Invitations
Michael HartmannYeah, I I would totally do that. And I still say I want vendor, I wish vendors would do instead of a free whatever premium trial for a week or a month, right? Give me three months for a cheap amount that I could pay so I can actually spend time exercising it. And because I'm putting some skin in the game, I'm gonna be more incented to spend the time to figure it out. Yeah, you have do you need to have more infrastructure for that? Maybe like and maybe you lose some deals because of that, probably, but like you're at least getting a little bit to recover from that.
Mike RizzoLike, I I think I think as as someone who's come from, you know, oh, all of us have interacted with SaaS companies most of our careers, but like as someone who came out of SaaS, like I I think I think there's also a tremendous value add to that offer, right? Which is like creating a stickier customer that is like more invested and feels like they're gonna stick around for the LTV that you want them to be around for, right? And so like le if you can like do a proof of concept motion, have them pay some amount of money to be on the platform for three months and give them an opt-out, and it shows that you're invested in seeing them like have success. And they're like, wow, like this is you know, this is great. Um, I know that organizations aren't always built to support that, but you know, yeah, I think it's money well spent compared to ad dollars, for example.
Michael HartmannYeah. Well, as always, fun chat and here we are. Here we go. We're at the end. We're at the end. Top of the hour, top the hour. I yeah, I've got I've gotta disappear. Um, well, thanks again. Like I wish we did, I do. We need to do this more often. I think we say that every time, and then life happens.
Mike RizzoAnd then life happens, yeah. Uh that time.
Michael HartmannYeah. So we'll do it again, I'm sure. Anyway, thanks, Joe. Thanks to all those out there who've uh listened and supported us over the years. Uh we always are looking for guests and topics. So if you have either one of those or we want to be a guest, you can reach out to any any one of us, and we'd be happy to get the ball rolling. Until next time. Bye, everybody.
Mike RizzoBye, everyone. Bye.