Jake Burghardt
Stop Wasting Research
In this brand new episode of Brave UX, Jake Burghardt explores how to stop research from gathering dust 🗂️, why timing matters more than tools ⏳, and how to make customer insights truly count for teams and strategy 🚀.
Highlights include:
- Why building a repository isn’t enough
- How to prioritise insights without losing value
- Understanding the timing of research impact
- When researchers should stop pushing insights
- The idea of a new “Research Integrator” role
Who is Jake Burghardt?
Jake Burghardt is a veteran of the research, product, and design worlds, with nearly two decades of experience helping organisations close the gap between what they know and what they act on 🔎.
He’s held senior roles at Amazon as both Principal Researcher and Principal Product Manager, leading large-scale meta-analyses, building insight systems, and influencing roadmaps and strategy across Amazon Retail and Alexa.
Jake’s expertise sits at the intersection of research ops, design ops, and product ops. He’s an advocate for “activating insight” and a sharp critic of the notion that buying a tool—or building a repository—is enough to make research matter 🚫.
He shares his thinking on IntegratingResearch.com, where his widely-read essays challenge conventional approaches to research effectiveness. In mid-2025, his first book, Stop Wasting Research, will be published by Rosenfeld Media, offering a new framework for reducing insight waste through better timing, smarter delivery, and deeper ownership of research’s purpose.
Transcript
- Jake Burghardt:
- No one's career should hinge on an individual team picking up an insight, right? No one should burn themselves out over pushing a particular perspective. I mean, if there's something that you see that you feel is wrong or there's customer harm, I think in this market the advice is tone deaf, but I always talk about voting with your feet.
- Brendan Jarvis:
- Hello and welcome to another episode of Brave ux. I'm Brendan Jarvis, managing founder of the Space InBetween, the behavior-based UX research partner for enterprise leaders who want an independent perspective to align hearts and minds. You can find out more about me and what we do at the space in between co nz here on Brave ux. Though it's my job to help you to keep on top of the latest thinking and important issues affecting our field of design. I do that by unpacking the stories, learnings, and expert advice of a diverse range of world-class leaders. My guest today is Jake Burghart. Jake is a veteran of the research product and design worlds, someone who has spent the better part of two decades helping organisations close the gap between what they know and what they act on. Over the course of his career, Jake has held senior roles in research and product at companies like Amazon, where he served as both principal researcher and principal product manager.
- While at Amazon retail and later Alexa, he led large scale meta-analysis initiatives, built insight systems from the ground up and helped teams put existing knowledge to use influencing planning cycles, product roadmaps and organisational strategy. Jake's work sits at the intersection of research ops, design ops and product ops. He's an advocate for what he calls activating insight and a sharp critic of the idea that building a repository or buying a tool is enough. He's also the voice behind integrating research.com where his widely read essays challenge conventional thinking and offer practical strategies for making customer insight matter. In mid 2025, Jake's first book Stop Wasting Research will be published by Rosenfeld Media. In it, he outlines a new framework for tackling insight waste, not through more reports, but through better timing, smarter delivery, and stronger ownership of what research is really for. And now he's here with me for this conversation on brave ux. Jake, a very warm welcome to the show.
- Jake Burghardt:
- Wow, thank you for that wonderful introduction. I'm very happy to be here, Brendan.
- Brendan Jarvis:
- I'm happy you're here with me, Jake, and you made that really easy with all the work you've been doing over the past couple of decades. And speaking of that work, I want to go back almost to the very beginning now, and that is that in 2006 I saw on your LinkedIn profile that you're a named inventor on a patent for gene expression or a data interface related to gene expression. Now that's something that's probably not on everybody's resume. What's the story behind that work?
- Jake Burghardt:
- I got started in.com after going through school in psychology, hitting human factors, class thinking, Hey, that's really interesting, taking another major in human-centered design and followed a partner out to Boston and did some consulting out there. And I met some great folks and when I moved back to Seattle where I live now, I ended up having conversations with folks that had kind of expanded out from those.com consulting days and were working at the company that makes the sequencers that were used to sequence the human genome and they were moving on towards commercialisation of a lot of those technologies and looking for new applications of them. And I ended up working with someone who you've interviewed in the past, John Kuda and Maria Taylor. We started up a small consultancy and we developed software. It was a generalist model where we were working with them on requirements research design, road mapping for a variety of different kinds of genetic software. And it's work that I still think about to this day as I try and turn more product development and delivery teams into laboratories with notebooks, scientific work was ahead there and that patent is just one of the designs that Limina and I participated in and thinking through how to assess the quality. I think in that case it was of microarray and it was an exciting time for visualisation, a lot of novel patterns and just a lot of fun work. Really enjoyed it
- Brendan Jarvis:
- Since those early days, I've noticed, and I think I mentioned this in your introduction, that you seem to be someone who has at least progressively over time positioned themselves at the intersection of a number of complimentary but slightly different disciplines. You've worked as a very senior UX researcher in the same in product management and also in operations, operationalizing these disciplines as well as doing some systems thinking. I believe at certain points in your career as well. Do you see yourself as having a core discipline anymore or have you always been comfortable operating in these grey zones, these intersections, these crossovers between disciplines?
- Jake Burghardt:
- Thank you for asking. I mentioned a couple times in that new book that you mentioned Stop wasting research. I have a generalist perspective from a lot of things. I think it comes from those experiences in the dotcom days of being in a shrinking company where I was able to try out a lot of different things and then going off and doing independent consulting with friends and on my own and really stepping into a variety of different roles based on what clients needed. And when I decided to make the switch to go in-house in bigger tech companies, I kind of got tired of throwing the deliverables over the wall. I wanted to follow through on things more. It came down to you have to make a choice there because they have job descriptions and guess what, they're not big generalists. So I went back to the first roles that I had, which were in research.
- I love to focus on problem finding before solutions and owning problem spaces and helping team think through how they could structure their problem space is better rather than just charging ahead with various ideas. And so UX research has been a core part of my work, but over time, again, the generalism crept in because I was really interested in getting more done with research insights and that involves reaching out into a lot of different roles and parts of an organisation. Even though my title ended up at Amazon as principal product manager, I was very focused on research. I was helping folks think through product development practises and processes, more operational things. And now that I'm in an advising capacity, I find myself in the generalist seat again.
- Brendan Jarvis:
- And you've been on that forefront of the operations movement, if you like, the research ops, design ops and product ops movement, that's certainly something in the last decade that's become more and more of a focus. Has it surprised you throughout your career that the groundwork for making things more efficient and effective, but especially between disciplines hadn't already been laid? That it was something that we hadn't really come to until the last decade or so?
- Jake Burghardt:
- I'd been in organisations, LAR organisations where there had been more thought given to it. It was a problem of scale. If you have X number of researchers, suddenly you can start to think about these operational factors. And there's definitely some big companies that have been doing this for a long time reached out and tried to learn as much as I could from them. As I started to dig into similar things, I did a bunch of research in creative agencies at one point and saw how ad agencies and different kinds of companies focus on operations. So I kind of had it on the mind from back then as well. And then it is interesting the timing. It was a scaling point in the economy and all of these different roles in technology and the desire to have more infrastructure, to have people stop recreating the wheel in their own little pieces of an organisation and find out ways to streamline things and make things, multiply forces and all of those great things.
- I don't know if it's surprising, but sometimes giving a name is the same as inventing it. There was a lot of this work going along and I'm really excited by it. I would say that and the different threads that you mentioned, whether it's research design or product, I mentioned them all in stop wasting research. I worked on, volunteered on the board of research ops community for a couple of years with an amazing group of folks, and it's exciting to see it all develop and I think we're hitting a point where some of the ideas are crystallised and making their way into more organisations, not crystallised, but codified, I guess, enough to kind of have legs, which is fun.
- Brendan Jarvis:
- Yeah, yeah. And I don't imagine there's many people out there that do what you've just done. I just saw Lou's posts on LinkedIn having a picture holding your actual physical book in his hands, right? Stop Wasting research is a real thing now and it's something you've been working on for a wee while. I wanted to ask you about the title because it's quite a powerful provocative title. Tell me about that. What is the story behind the title
- Jake Burghardt:
- In the proposal creation process? Kind of debating. I'd been writing, as you pointed out, a set of articles on this stuff for a couple of years, kind of structuring it into an idea of a table of contents, thinking I was going to pull it together into some sort of volume. And I ended up having conversations with Lou Rosenfeld and reshaping the ideas of the structure of the book. It started with research repositories at large. This was the topic that was driving the writing process. I wanted to contribute to some things, ideas that I had in that space that I didn't feel like people were talking about as much. And over the past years, it's been an explosion in that space in terms of vendor content and all sorts of ideas, but still, we're at this place where a lot of people are saying the most common questions are what tool do you use?
- And then sometime later, why is this failing the goals part of it? What are we trying to do with these tools? I've always come at it with a focus of getting more value from research. Researchers are already doing amazing things in their study processes. They're delivering all sorts of value in product and development and delivery in terms of new opportunities, refining ideas, go to market, all these different aspects that have folks hiring researchers today and understanding that that's more of a challenging market than in previous years. But what I'm really focused on picking up the remainder, I've had a lot of roles where I've been able to say, look through volumes of research and see how much was left behind and not just the ancillary stuff, major insights that are directly in line with what leaders are talking about now that they have no idea exist.
- So picking up that existing research and getting more out of it, and I framed it as waste in an article fighting research waste. It had more legs, people were activated by that. It has sort of an activating emotion. And when we were talking about how to frame that as a title, the most active framing that we came up with was Stop wasting research as something that takes a topic that could be sort of dry and archival and turns it into something that says, Hey, there's really something lost here. And it's not just lost in terms of researcher efficiencies or cross silo wins. There's losses for the product. This is about maximising product value from organisations, customer insights.
- Brendan Jarvis:
- Yeah, I mean the title is certainly evocative and it really is getting to the heart of that travesty. Perhaps that's a bit too evocative itself, but that wasted opportunity that exists that like you suggested, many leaders, executive or otherwise probably not aware of the depth of insight that is available to them. And I know that you've previously suggested that researchers should, and I'll quote you now, research how planning works in their organisation. And I know at Amazon you were very much involved in aligning insight delivery with key decision points. You even went so far as to tactically display research work physically in offices at very deliberate places, in very deliberate ways. What do you believe that is so essential for researchers to grasp about understanding how their organisations, organization's plan?
- Jake Burghardt:
- Thank you for that question. If we think of studies as sort of this unit of work, and we have this ideal where researchers, you imagine the perfect research project and it could be in a variety of disciplines where you align with a group of stakeholders and develop questions and methods and take them along for the ride in the process and the analysis. And you have those great readouts and you're changing minds, you're working your way into backlogs and goals and these various things. But the problem is is that the remainder that wasn't in sync, it didn't land because it wasn't in line with what folks were working hard to implement at that moment. They just didn't have the space for it. But if you bring it back at another time, they might, it didn't find the right team or leader. Organisations planning is so fragmented that one research report can influence a huge number of teams, but our model is still based around this deep partnership model which get as much juice out of it as you can, but there's lot more that we can do, especially if you compile insights and route them to the right places.
- So studying planning is about thinking through it can influence the study process itself. I have FAQ at the start of stop wasting research that is essentially, this is not a book about conducting research. This is about everything that happens after. There's a lot of books out there about conducting research. But when you study the outcome that you want to see, when you think about the places you want research to show, when I'm advising folks, some folks it's a quarterly review cycle. Some folks it's five particular teams backlog grooming processes that own the most important things. Other folks, it's an executive quarterly review on the way to resource planning. If you understand where the decisions, you want to influence all those insights that aren't making the cut where they could make the cut. And then you work backwards from there and you develop essentially information architecture and practises and experiment towards getting the research to those places. That's how you can take content that is sitting in digital junk drawers and various systems and kind of start to iteratively make your way to the places you want to be.
- Brendan Jarvis:
- And if you are sitting here listening to us talk about this and that is sounding like something that you want to be doing, do you have a clear picture in your head as to who specifically whether it's by title or some other way of thinking about who within the research organisation might be best positioned to make something like that happen? Are we talking about any and all researchers? Are we talking about research managers? Are we talking further up the chain? Who exactly do you feel is the best positioned in large enterprises to make the most of this type of insight they could get from stop wasting research?
- Jake Burghardt:
- So in the background of the book, we talk about researchers of any stripe. I use a broad definition of research. When you think about all the folks that are trying to influence decision makers in organisation, UX research is up against market research, data science, research science. We're kind of all jockeying independently in a lot of cases to influence the same stakeholders in a lot of what I talk about is banding that together. So it could come from any of those places and it's really the person that gets the biggest bug about this problem. Or I talk to a lot of folks that have a repository goal and then they're really wondering what that means. It's not just the tool, it's an initiative and we could talk about that. I also target the book towards the decision makers themselves, design and product folks who want to see their organisation make more decisions based on research.
- And as we spoke about earlier, this kind of growth of operations folks is a natural home for it as well. I think part of the challenge of writing the book and saying research your organisation and its planning processes and work backwards from it is that there's not going to be one pattern for this or one natural home. I have a part in the third chapter about trying to find that home and growing an initiative from a crawl to a walk to a run to a marathon. And there's not going to be one way to do it. We can focus on common root causes of the problem. We can look to adapt to the outcomes that we want to see so we can map the research assets that particular organisation has come together and say, okay, what are we trying to influence and think about the wins we've had that we want to see more of and the losses that we've had and work from there.
- And then it takes many hands in the end to reduce research waste. I mean the initiative has to start from somewhere. It's often from the people who feel the pain more intensely, which can be researched, but this could be a product operations function as well. And over time you're going to need a lot of different skill sets. And so an initiative can sort of beg, borrow and steal and do project-based work to say, leader, I need a commitment from this person for a certain amount of time. Whereas a research team in and of itself may have a lot of those skills in it and may need to reach out and find other skills as well. And in the end it comes down to someone making the choice to use research in their plans. And so the scope of people involved in this, this is a change management initiative that can start as a passion project of a person that gets some early experiments off the ground.
- But the goal is through iterative wins and kind of thinking of how to address some root causes of research waste, you can get to a point where a lot of folks are involved, not because it's some mandate, but because they see it as something valuable. It's worth their time. It helps 'em get more done with their insights on the inside generating side and on the insight consuming side, it helps them justify where they're going and inform where they're going and drive where they're going in a way that leads to results and provides rationale and eventually people start to recognise as a common pattern that isn't just research being used in a vague sense is much more concrete than that in a way that can have positive feedback loops.
- Brendan Jarvis:
- Jake, you spoke a couple of times there about the root causes of the problem, if you like, of research being wasted and one of the ones that I feel that we've touched on so far has been the timing, the fact that people are busy and they're focused on other things and therefore they can't focus on everything that might come out of a study or a series of studies. You've also suggested that researchers can tend to think of their stakeholders as superhuman as in that they have the capacity to focus on all of those things all of the time. What are some other common causes or what is the most significant cause perhaps if we haven't spoken about it, of research going to waste and what can we do about it?
- Jake Burghardt:
- This became the framing model for the book and it organises a lot of the chapters and sort of thinking about ways forward. It presents a big menu to address the root causes and given people's circumstances are so different, no one's going to try all the ideas in there, but they might find some things that would be useful. And the model that I came up with was preparation, motivation and integration. So integration has a lot to do with the getting in sync. It's that research isn't available and present even if there's mindshare for it at the touch points that matter for certain kinds of decisions or it could be involved in a lot more of them. So a researcher may have run the perfect study, delivered the results, had some wins and there's a bunch more insights that could be influencing decisions, but they're not showing up at the times when those decisions are made in that model where we have this trend where decision-making is just more and more distributed to more and more teams over time.
- How can a researcher, if you're kind of focused on delivering to a certain set of stakeholders, we got to set things up so it can be routed and present at the times. And that's what integration's about. There's things in there about pushing more visibility of insights about citing insights and having a clear ask of how we want research to be used. And there's things about the particular touchpoints in design, in decision-making processes like product backlog processes, marketing, the various types, and then in leadership processes, well, so in more corporate operations environments kind of pushing up the chain. So integration is that last one. To go back to the first part, preparation, we're creating all these individual outputs. We have all these assembly lines creating insights. We're not connecting the dots between 'em. They're not preparing the research that hasn't landed to have that impact over the long haul, we can put it into a repository and make it searchable.
- That's a step forward. I talk about report libraries in the book. What's the unit that's going to be easily addressable in planning? What's the thing that's citable? So I talk about insights summaries for top insights where we pull together a variety of different types of research and create the best case we can in an authored way that can be picked up and pushed out to teams at those integrated times and something to keep people aware of, to add evidence to over time and to share the wins when they happen among the research contributors. So preparation has to do with starting to break down silos, whatever that means in your organisation. And there's a bunch of ideas about that. There's some ideas, concrete ideas about research repositories. Obviously if a reader already has one in place and they're happy with it, there's a lot of ideas for bringing it to life, but for the folks that don't, there's some ideas and what does it mean to prepare things now for later use?
- We talk a lot about speeding up research processes so that we can recruit faster, we can run a study faster. All these marketing claims about new data and they're delivering in some cases and what can be faster than continuous rediscovery, knowing what's there and having it ready. So at that moment for the things that are most important for a research community, they're ready to be injected into conversations and shared. So that's the preparation piece, the motivation piece in terms of a root cause. The second root cause is that research is too often seen as an optional input and it could be driving more conversations in private. It's the thing that a lot of researchers talk to me about. They count their wins, but they really feel the losses and there's a piece that's missing there and some of it is we show up with everything and that's a problem with repositories where it makes it very acute, the problem of prioritisation and suddenly showing up with 20 findings from a study that aren't ranked very well, which happens in fast research often is one thing, but when you show up with a few hundred across pulled from a repository, suddenly you end up in a totally different ballpark where prioritisation becomes a much bigger issue.
- And so there's a chapter on ways of thinking through that from customer perspectives and business perspectives, A different perspective on frequency maybe than some folks are used to digging into spotlighting different things and matching leadership interests is another form of prioritisation. There's ownership and I'll wrap up with just mention the last couple chapters here and then I'll summarise the model ownership on the research side and on the product development side, there's a bunch of ideas in there and how they meet in the middle. Everything from extending study timeframes so that you're not just delivering and done to collaboratively articulating insights together and there's opportunities to change how we measure success, where it can be everything from lining research to goals, pushing for new goals, taking metrics and making them part of the research conversation where we say, Hey, this metric's lagging, let's tie a bunch of insights to it. There's a bunch of ideas in there, but preparation, motivation, integration are the three root causes that I arrived at and they became the structure of the book.
- Brendan Jarvis:
- It sounds like a really clear structure. I want to zone in now on one of the things that you said while you were describing that, which was the challenge around prioritisation, so turning up with basically too much for people to focus on and therefore things getting lost, right? It's just too much noise. How did you become comfortable with leaving things out?
- Jake Burghardt:
- I was really bad at it for a while. I've certainly been the researcher that shows up with what people call an embarrassment of riches, which at the time I felt like, oh wow, great. And then I realised that it was maybe not the right thing leaving things out. I think when you take the long view and you think about systems for activating research over time, what does it mean to leave things out? Well, repositories, depending on what stripe you have, they can hold everything. You don't have to leave anything out. They can come up later, it can build more evidence, it could connect to a different team. So what you're leaving things out of as a particular conversation and what you're doing there is you're focusing a conversation. I think the thing that I've talked to a lot of folks about is researchers that feel uncomfortable about it is they do this all the time, they just don't think of it this way.
- You focus on certain questions and certain topics. As a researcher, you're prioritising. You're saying what's important. You have sort of skin in the game there of working with stakeholders or in some cases for more exploratory work teams that own their own space and are working to fill out knowledge for their leaders. There's a huge amount of prioritisation that's involved in that. We just don't necessarily think of it that way. And then the executive summary that ends up on a big report, a common pattern people. So there are things that people are already doing that are in this space, and to your point about leaving things out, I think it's leaving it out for now and then knowing that if it's really important, we can bring it back and we can find the right conversation for it. And when you stop treating research as a momentary spark that happens an aha moment and you start treating it as a durable business asset that can accrue over time and it's much more durable than people commonly give credit to. The pain of leaving things out can lessen, but as an author in the moment, I've certainly felt it.
- Brendan Jarvis:
- It certainly sounds to me like you are encouraging us to think more strategically. I think you even mentioned the long term about making the most out of all the energy and effort that goes into any and all studies that we're involved in. This is almost like an overarching way of thinking about maximising the impact of research over time.
- Jake Burghardt:
- I think that's right, and some researchers are always looking broadly even when they're down in a niche silo, others hyperfocus on current needs and it's not an either or. People may do the same thing in different time depending on the constraints they're under, but when you create systems that make it so that you're more confident that the insights that you find regardless of whether they fit the current people you happen to be talking to will eventually find the right home. If they're important enough, then suddenly it does change the way researchers think about their work. I've had people tell me that they document more and not for documentation sake, they pick out more of the things they think are really important, that if they didn't have those kind of operations and channels in place, there was no option to make that work visible and to find the right owner that they wouldn't have even bothered to write it up in the first place.
- Brendan Jarvis:
- Yeah, yeah, yeah, yeah. Thinking about the decision-making process that goes into what not to present or what not to include. Now you touched on earlier that that's already happening based on what your research question is. For example, you've already excluded other things that you could have asked. Some of that may be conscious and deliberate and some of it may be just happening as par for the course of conducting the work. But when you've been thinking about purposefully what to include, and I don't know if this is tied back to something I heard you say to Lou on your conversation with him on the rosenfeld review, but you suggested that it seems like a framing for this, so tell me if this is incorrect or not. You suggested that and I'll quote you now. One way of framing it is what would our competitors pay to know what we are forgetting? And to me, even if it wasn't intended that way, that sounded like a really powerful lens for looking at what you could include and making decisions based on that. Was that the way you intended that or is are there other ways that you've made those hard decisions?
- Jake Burghardt:
- I think that's one thing that I come back to, especially when I'm looking at a body of stuff that's been on the cutting room floor as I sometimes call it, and we could pick it back up and make another edit and have a whole other conversation based on what's been left behind many conversations in some cases. I think that that's definitely one perspective. I think you start thinking about the importance of opportunities and issues and finding ways. There's common usability methods around this For a long time, market research has done this. Data science weights different things. Every research discipline that might contribute to your efforts is going to have a perspective on it, and I think the thing that I talk about in the book is you're really just trying to come up with some tears. You're not trying to rank everything. I think it becomes a problem with researchers sometimes where you feel like you need the exactitude.
- This is a layer that's applied on top of your already excellent study. It's not a reflection on your study. And if you go and ask a bunch of teams about how they prioritise their work, everybody wants to have a great rubric and may show you something, but it's often not that complicated. And I've talked to a lot of teams that didn't have much of a rubric at all. It was just judgments based on comparing individual items. So if researchers just developing something basic and not try and rank every last insight into a stacked rank, but just put some tier together. Let's say you got a list of insight summaries that compile a bunch of research about particular insights. What are the ones that are less important for driving metrics lifts or reducing customer pain, which are the ones that are the most promising in that regard?
- You're placing a bet, you've got some skin in the game. If you have an initiative that's sort of an umbrella over researchers' work, it can take the blame if it doesn't go well, but it puts you in more of a position of a stakeholder, not just an information source, which is something that is important to me for research, and it's something I talk about a lot in the book and a stakeholder isn't always 100% right. They're contributing to a conversation and their priorities are not what the owning team that implement solutions are going to adopt wholesale. They have to balance all sorts of things. You're just one more voice. And so it's a topic that I'm excited about the chapter that I put together there and to hear what people think about it. I got some positive reviews about it and the technical review and I think people are probably doing all sorts of interesting things that we don't have eyes on behind the scenes because can be a bit of a secret sauce.
- Brendan Jarvis:
- What was it that people were particularly positive about?
- Jake Burghardt:
- I have some models of how to break down customer impact and business impact and I got some positive feedback about them. I was worried that they were too complex and I didn't get that response.
- Brendan Jarvis:
- When you were describing that where my head was going when you were just talking about the different, I suppose, stakeholders in different departments and the different goals that they might be pursuing, it seemed like the same insight could have different levels of value depending on which department might be looking for something like that to help them make decisions and also at which point in time it might be more salient to them, is that one way of thinking about
- Jake Burghardt:
- Prioritisation? It's pretty easy to go pretty far in the weeds. And so I do say in the book the most important sort of metadata for an insight summary is owning teams, people who might make progress on something that allows you to route insights. But I don't have the prioritisation kind of pivoting based on which owner. Essentially if you look at a team's backlog, they have stuff that's come to the top variety of different kinds of teams. They got a whole bunch of stuff in the middle and they have some things that they're probably going to cut. So I think we can apply a tonne of nuance to it, but if we could just take a filter to a set of insights and say in our backlog for the customer that is this list of insights, this is one of the things that we think is really important and here's why. They can look at the rubric, decide if they agree with it or not, but more often than not, it has a lot to do with just the fact that you brought that insight to them in the first place. You thought it was important.
- Brendan Jarvis:
- That sounds really simple, but I get the feeling that the devil's in the detail just how much is required to either create or manipulate an existing tool to, I know this is a hard question to answer because there's no real way of answering how much energy is required to do that, but I get the sense that people have to be up for quite a bit of work in order to get things to work in a way that works for their organisation.
- Jake Burghardt:
- Yeah, that's a big conversation. I mean, I advocate for using tools first, evaluate the tools that are already in use, particularly the tools that are already used in planning, like why create something new? I have somebody learn something when they can use something that's more native to them. There's a lot of things out there that have repositories on their list of attributes that are really fancy analysis tools. Those are super powerful. I'd be excited to use a lot of 'em, but when it comes to figuring out how to stop wasting research, I'm not talking about analysing new studies. I'm talking about taking existing insights and getting more juice out of them. And so I think which tool is one of the most common questions I get, and that's my default position is just, okay, what tools are you already have in house? How can we make the most of those?
- And then making it work from there. It really is deeply dependent on context and not everybody's going to run to prioritising individual insights down to the end level. And again, this book is full of ideas to take or leave based on what's most useful to you. I'll give you another approach to doing something similar. Another approach would be just to say researchers promote the insights that didn't get traction. Track all your impact and your impact trackers. Ideally shared impact trackers. So as a community we can all build on each other's successes and there's ideas about that. There's a lot of great articles out about that in the industry, but I think it's probably the topic of another book to be honest. But then for the things that haven't gotten traction that you want to promote them out and we have this set of insights from across research studies. And then another way to think about prioritisation is not some abstract rubric that we apply and figure out what to surface other ways just to say this quarter's priorities are X, these are the things that align mostly with those priorities and these are the obvious things to bring up. And it's not an either or. You could do both, but as I say, there's a lot of ideas in there that there's categories of intent. The chapter is called clarify what matters most. There's a lot of ways to get there and some different branches of ideas.
- Brendan Jarvis:
- So I get the sense it's almost that typical consultant's answer of it depends and there's very good reason why. It depends because like you've talked about context several times, every organisational context and every research team's context is different. If we think about what I understand, having not read the book, having just heard you talk about the book though, I understand when you are describing the model behind the repository that you could consider implementing. So it's less about tools and more about ways of thinking about that. You speak in the book about a library of reports, like a dual repository model, right? A library of reports and then a more actionable insight summary hub. And I was mainly curious about what seemed like an intention to at least split or perhaps it's just present differently, those two things. What is it about those two things working together that you feel is more powerful than an alternative?
- Jake Burghardt:
- I churned on this topic for quite a while where in the past I had pushed researchers to create insight summaries for everything, for example. But I think a tenant for all of this work is that you should get much more value out of it than you put into it. And I just didn't see people getting the value out of that. They already had reports. You can incorporate all sorts of outputs from all sorts of disciplines. It becomes a common denominator. You're not trying to create a tool that owns all sorts of research processes end to end, particularly if you're trying to really break down silos, outputs at the report level are something that can be consolidated without too much difficulty. It's an extra step. Ideally there's some standard definition of header and attributes, but this is not heavy lifting. And the payback that you get is visibility for your work and the opportunity for more follow throughout of it as a contributor.
- So you're kind of adding into this repository that people may go search, researchers will definitely search other folks. You'll have some lead users you'll have even that little bit of adoption that you'll get is a step change for follow through on research From there, I think that's where the struggle is, is having everything in one place doesn't guarantee a whole lot. You can create more mindshare for new findings, new being a filter that really works well. People are excited to learn what's just in. But when you think about trying to get things done with insights, that's where the insight summary idea came in. This is the thing we want to see linked in a plan. I've seen these things take off to where before long there's CEO level documents with these insight summaries cited in it. I think it's sort of the unit. It's not about analysing.
- There's lots of different ways of atomizing that are about finding themes and atomizing. It's once you have some themes, how do you document it in a way that's ready to be picked up? You're preparing it for use, and that could be in two different tools that could be in the same tool. I talk about it a little bit I think in all of it. The topic that I didn't get to that I think I have some more writing to do about is point of view in research tools where the structure and what we include in a research tool that we open up access to has different degrees of point of view where if you are pulling together all sorts of evidence streams and you're calling that your repository and you're throwing your reports in there as well, you're kind of mixing things that are very low point of view with things that are very heavily interpreted by skilled professionals already.
- And so what I'm trying to do is elevate the bar towards things that are higher point of view, connecting back into evidence. And then what has the most point of view is when you've done the interpretive labour of saying this is a primer as Andrew Ard talks about for a particular insight, this gives you what you need to know about it and you can kind of connect this forward into planning. I think there's a million other ways to do this, but again, my frame is about reducing research waste and I'm always interested in learning how other folks go after those problems. But I think when you look out at the variety that's out there, they have unclear goals and they tend to focus more on empowering researchers where now researchers are in the research process I should say, where now researchers can include a wider variety of roles, but once you've found the goods, how do you get more done with it?
- It's like AI tools. I'll just one more thing. It's like I talked to folks, tool vendors are interested in connecting and I talked to some folks who are creating tools, oh, it's going to analyse all this stuff. And I said, well, every time do I run it? Do I get something different? It's like that's a low point of view tool, especially when it's taking heavily interpreted work and munging it into a summary and the next time you run the summary you get something different. I think this is so counterproductive to the value that researchers provide and so much of what we're trying to do is create structures and language and common focuses for planning. We're trying to build that problem space and whatever repository helps you get there, I'm all for it.
- Brendan Jarvis:
- I'm playing catch up here mentally. So tell me a lower point of view artefact if you like. Am I correct in interpreting that as say the report and the higher point of view is the insight summary that might be derived by looking across multiple reports?
- Jake Burghardt:
- Yeah, I think that's fair. And then where I really want to point the emphasis is on the lowest point of view, which is a pile of customer support calls being called research and an analysis tool unleashed on that with some social media thrown in there and research report evidence and maybe a few finished research outputs. So it becomes sort of this soup of different data sources. It's an interesting analysis tool. I'd love to play with it and as a researcher in a space. But when it comes time to driving action, I think that's where we're in the low point of view territory where every time you come to it, you're not finding that common language, you're not finding the problem space. You can't align multiple teams around something until you create something out of that.
- Brendan Jarvis:
- And I sense from the way you've described that in particular say that AI tools influence in creating different summaries every time you run it against that data set, that there's something inherently unnerving about that presenting a different point of view every time it's run that devalues the potential of that data in the eyes of stakeholders.
- Jake Burghardt:
- I think they may love it. I think we're all amazed. I certainly am by the outputs that many tools can generate. It's an amazing time and things are getting better and things will refine and be more useful. But to your point, I think what we're trying to do is build common structure and language and things to reference to drive particular customer needs forward in planning. And the user-centered design days of when I got started, there were these sort of big methods that were aligned a lot with waterfall and big models and things. And the thing I've struggled with a lot of folks is how to better build out problem space knowledge for this highly distributed world. And I think that some of the approaches in the book are a solid stake in the ground for that and they do rely on some consistency. And so AI can get there.
- AI can create that consistency I believe. It's not like I'm slagging it in any way, but it's a means to an end. I put some tenets in there for AI and research systems and it's such a fast moving target. I wanted to put some higher level principles for it where it shows up. That being said, I think a little bit like some science fiction authors will write every last detail about how a system works on the technical sci-fi side and then others will just say, they said this and something the outcome happened, right? They don't tell you that it was an ai. They don't tell you. I think a lot of the things in this book and that I'm pitching could be very much enabled, especially over time as the systems get better, but not at the cost of building that common problem space, which I think some tools are kind of interfering with right now personally.
- Brendan Jarvis:
- Well, let's come back to a little bit back into the conversation a little bit earlier in the conversation where you were describing the insight summaries, finding their way into executive level reports or decision making. And you spoke about how when you first got started in the industry was sort of talking about the dotcom sort vera and there was this also around that time there was this mentality of build it and they will come. And I get the sense that that may also apply to some of the thinking around these repositories. And what I'm getting to is I'm curious to understand what you feel is necessary outside of say the perfect system to shepherd or ensure that work and those insight summaries are actually making their way into the right hands at the right time. What is the effort or energy that's required outside of the system itself to make that kind of happen? What kind of leadership or actions are important?
- Jake Burghardt:
- That's a great question, and as I said, I started out sort of writing up ideas about repositories and ended up talking about all sorts of things that were enabled by the information that comes out of repositories, but really about changing practises and culture change around thinking about and small changes for using research. So when you look across the various ideas and sort of the body of the book, the sort of menu of things to choose from, go after those root causes of preparation, motivation and integration. There's some things that speak directly towards the tool. A lot of it is more about pushing visibility, extending the reach of insights around an organisation. So many things added value to a particular team at a particular time, but there are 10 other teams that could use them right now. So a lot of it's about routing and increasing that general awareness of insights that makes sense for particular teams.
- There's things in there about where to connect and how to connect. I think thinking hard about those touch points that we talked about earlier, the outcomes and planning and working backwards from there. There's so many of these practises in a lot of research processes. We sort of present results and we may ask for responses come back later and track, but a lot of times people are too busy, they move on to the next thing. But there's just a lot more follow through that can be done by the individuals conducting studies than other people picking things up and aggregate that make these tools come to life. The tool holds the information and enables certain use cases, but I think that one of the traps that people fall into to your point about build it and they'll come is thinking that folks are going to arrive at this tool and discover just what they need and walk away and do things with it when really a lot of consolidating knowledge and preparing it for use is getting ready for it to be shared. It's when that moment of continuous rediscovery comes up, it's having that content ready to go and it's about push. People don't like that word. Some folks, and I even say inject, I don't want to tap dance around it. I want to get research in more places and get it into conversations where it isn't. And depending on the company culture, it can show up in a lot of different ways, but those tools are enablers of more targeted conversations over a longer period of time.
- Brendan Jarvis:
- And this is more, I'm getting a sense it's more than evangelical angle that has been talked about for a long time in our circles. It's less about that. It seems to be more about you already know that there's great value in what's in there and we need to get it in the hands of the right people at the right time. Now you communicated some reluctance around some of the terminology there about pushing and injecting. There's something I think that I'm personally comfortable with, but I can understand why others wouldn't be. But you also have spoken about previously that researchers need to understand when to move on. I mean, there's just sometimes things are going to fall on deaf ears for whatever reason. I mean, is it overtly obvious when you need to move on or do you have some sort of bar or benchmark that you would reach internally when you are in practise that you would go, okay, it's the third time now that they've not listened to me. I need to find a team that's more interested in what I might have to contribute. How can people think about when to stop pushing their value on others and when they might need to find someone else to serve?
- Jake Burghardt:
- It's a really good question, and it's covered in a few ways in the book. I mean, I think that there's finding the right teams. Sometimes researchers are embedded in low value teams the way they can add a lot of value compared to other places in an organisation where they can add value. And when you start consolidating research knowledge, it can become more apparent. But also on the flip side, by creating a situation where research can find the right audiences and that folks can be connected, that person who's in a smaller node can be connected to more of the people that they could be impacting position in the organisation matters, but it's not necessarily a dead end. So I think that's one piece of what you're talking about. But the other piece is just the broken record. I talk about researchers having a horrible time getting folks to act on a particular study, and then I show up sometime later with the export from a repository with the researchers.
- Same work, collated with a few other folks, but it's not the fact it's collated with a few other folks. It was just the right time. So we've talked about timing, but some folks are just not going to be open to hearing certain insights. It doesn't fit their worldview. No one's career should hinge on an individual team picking up an insight, right? No one should burn themselves out over pushing a particular perspective. I mean, if there's something that you see that you feel is wrong or there's customer harm, I think in this market the advice is tone deaf, but I always talk about voting with your feet. But when you're pushing and you get feedback that we've heard it before, I think the first thing that folks do is there's the tendency to think of insight has to be brand new. And these insight summaries are ingredients of a planning process.
- They don't have to be brand new and they can accrue additional evidence over time for the other studies as things come in to freshen them up. So the first pushback is not necessarily the walkaway moment, and sometimes it depends on the severity of the problem or the opportunity, the importance of it. Some things you definitely want to push on more if you're comfortable and come back more times with other things. You see that it's not moving and maybe it's about finding a different team that would be interested. That's certainly been something that's been a recurring theme or waiting for the leaders to change over or to our earlier conversation. The goal setting cycle for the year comes up at that organisation and suddenly they're all ears about new ideas. I wish there was an easy answer to it, but I think I would stress testing the limits a little bit.
- Brendan Jarvis:
- Do you think that there's a new role here somewhere in the midst, all of the work that you've been doing? Or is this something that you feel can be this type of an approach to stopping, wasting research can be achieved within the existing role types that we have in our organisations?
- Jake Burghardt:
- I struggled with the writing of the book, so many books. They talk about a new role and we've talked about design ops, product ops, ops and the great bodies of knowledge that are coming up around that. And books from Rosenfeld Media, my publisher on some of these topics. And I struggled with the who. And I think that there's someone that gets this in their craw and I've talked to a bunch of folks who are this person. They're often a research leader. In some cases they're in product, some cases they're in design, they're the sort of the initiator. And then from there, the diversity of skills across that spectrum are large. There's a lot That's just basic programme management. To keep those insights alive requires some operational work that can be done once it's codified a little bit early, experiments that turn into wins, we could say, Hey, let's do that every month someone has to do that.
- I think the harder part where I think more to your point is the thinking in what are those experiments and what should we do? It does take a certain kind of mindset and I don't know that it's bound to a particular role. It's someone who has a passion about getting more done with research and is willing to dig into organisational change, which isn't everybody's cup of tea. A lot of researchers are amazing researchers, but this would just not be what they would want to do. And that is absolutely fine. And there are product people who get really frustrated by their ideas that are based in research, not moving forward while something that's more of a hot trend that's not based in research moves forward, that kind of person can get excited about it. Design is a natural ally. I've definitely sat in large design groups and benefited from design ops people who didn't have that title. They were producers or programme managers. So I struggled with that topic. I wouldn't rule it out. Somebody asked me if there was this new thing called a research integrator. I don't think one person can do it all. I think that you need an initiative. An initiative has a leader, and that leader has to be passionate about it and have a perspective on what would be useful. And there's a lot of ideas in the book that can fuel a person like that.
- Brendan Jarvis:
- You spoke about design being a potential ally, and you've also spoken about a number of times today, this idea of taking the long view. There's definite hints of this being a strategic enabler of research and value for companies. And you've previously said in not so many words that this is in a short game. It's a very long game as far as I imagine, implementing this type of programme within the organisation. What has helped you in stay in the game when things are working slowly or the wins aren't immediately evident?
- Jake Burghardt:
- Yeah, I think part of it is finding quick wins that justify the value of doing this kind of work. Resuscitating some old work, doing a big meta analysis of a topic that's really of current importance that people get excited about past research, experimenting with new kinds of reporting long before you figured out a repository to connect the dots between folks or just encouraging folks to work together more. I've gotten a thrill out of kind of supporting research communities, especially across disciplines, but over the long haul, that's where the product management side, when I did flip the title, it was in part because I was road roadmapping out ideas and connecting with a whole bunch of teams, influenced without authority, all those sorts of things. And what kept me going, what keeps an initiative like this going is each incremental win. I talk about going from a crawl to a marathon, and I think we're talking about sort of not that first stage, but kind of when you're moving on and it's being able to broadcast through whatever channel a story to champion the use of research that resulted in something great, which then snowballs, which then gives credit to the researchers who contributed to it.
- And also the discipline gets elevated by it. And the brand of your initiative keeps getting more and more prominent in conversations about what should be next. It's learning to take those small wins and really celebrate them, I think, and turn them into opportunities for the whole thing to have a positive feedback loop.
- Brendan Jarvis:
- I could hear the passion in your voice as you were describing that it really came through loud and clear, and you've been doing or laying the groundwork for stop Wasting research for some time, and you've been writing about this for some time on integrating research and now it's a month or two out from Stop Wasting research coming out. So this is right at the very exciting point for you. When you reflect over the time that you've been sharing your thoughts on integrating research as well as what you've received so far on the book, what has most surprised you? What's been the most pleasantly surprising part of doing this endeavour?
- Jake Burghardt:
- I've spent a lot of time kind of reaching out and doing advising to check in with folks to see if the ideas resonate in their environment, so very in particular context and putting the ideas out in the world and hearing in a general sense that, oh, that makes a lot of sense that it's filling a need that I see as an underserved area and just taking in the weak signals that we're heading towards something that could be useful. And what's been surprising is, I'll be honest, as an author, I'm always waiting for the pushback and you throw up an article or a LinkedIn post and it's pretty easy for things to get trolled for folks to come in and say something like, repositories are dead. They don't do a damn thing, do new research. I see all these posts, but I see pushback on some of the ideas outside of what I've contributed, but inside of what I've contributed, I feel like I've just built some amazing connections and learned from a lot of folks along the way, and I'm happy to have incorporated some of their inputs into the book itself. So what's surprising is the thing that's exciting to me is also a topic of experimentation for a lot of folks, and it's an interesting time to kind of pull it all together.
- Brendan Jarvis:
- And that's a great time for us to bring the conversation down to a close. Jake, this has been a really enlightening conversation. Thank you for so generously sharing your stories and insights with me today.
- Jake Burghardt:
- Thank you so much for having me on. It's been a real pleasure and I've gotten a lot of value out of Brave ux, and I'm just amazed by the archive of thoughtful interviews you put together, so thank you for it.
- Brendan Jarvis:
- Oh, Jake, you're most welcome. I'm very humbled by those words and I'm very excited for you that stop wasting Research is coming out soon and people will be able to get their hands on that. I believe Lou Rosenfeld was saying it's roundabout June that it should launch, and if people want to keep up to date with you and when the books available, what's the best way for them to do that? You
- Jake Burghardt:
- Can go to stop wasting research.com right now and that'll take you to the Rosenfeld page where pre-orders are available. It does ship in June. I have a website called integrating research.com that you alluded to that I've updated to be more of a personal site that links out to the articles and you can connect with me there. I'm active on LinkedIn. That's the best way to reach out, and I look forward to hearing from anybody who's interested in this stuff.
- Brendan Jarvis:
- Great. Thank you Jake, and to everyone who's tuned in, it's been great having you here with us as well. Everything that Jake and I have covered will be in the show notes, so don't forget to refer to them. If you want to hop back to something that we discussed specifically today in this conversation, if you've enjoyed the show and you want to find more great conversations like this with world-class leaders in UX research, product management and design, don't forget to leave a review. Those are always very welcome and very helpful. Subscribe. And also perhaps if there's someone that you might know that would get value from these conversations at depth, then please pass the podcast along to them. If you want to reach out to me, you can find me on LinkedIn. There's a link to my profile at the bottom of the show notes, or you can head on over to my website, which is the space between co nz. That's the space in between co nz, and until next time, keep being brave.