Advertise on podcast: Awkward Silences

This week we're revisiting one of Awkward Silences' most memorable episodes. This episode welcomed George Whitfield, an expert in applying AI to the analysis of qualitative data. George discussed the intricate challenges of leveraging language models to interpret expansive open-ended data (like interview transcripts), and emphasized the importance of context and not just keyword or topic identification. Episode Highlights 03:48 - Innovating consumer insights using AI12:21 - Importance of human involvement in AI tools20:04 - Enhance discussion sections with  AI tools26:50 - AI-inspired insights provide inspiration, not guidance34:12 - Interpretation beyond analyzing transcripts36:46 - Applying engineering rigor to the process of building a businessAbout Our GuestGeorge Whitfield is an Entrepreneur-in-Residence at the Martin Trust Center for MIT Entrepreneurship, Lecturer at the MIT Sloan School of Management, and Software Engineer at Google. George holds 4 patents and has 3 degrees from MIT including a Bachelors in Electrical Engineering and Computer Science and a Masters and Ph.D. in Materials Science and Engineering. Resources on Qual Data and AI Our AI in UX Report shares findings from a survey of over 1,000 researchersWhat does it mean to "code" qualitative data? This breakdown explains it all.Interested in trying an AI tool for your analysis? Here are 20 worth considering.

Erin May sits down with Aneta Kmiecik, founder of Be Your Own Design Team, to tackle one of the biggest questions facing designers today: how to position AI skills in portfolios and resumes. With 15 years in creative industries and a community of 200,000 followers, Aneta brings unique insights into navigating career strategy during this AI transformation. Aneta reveals her Past Present Future framework for career positioning and explains why most companies aren't explicitly requiring AI skills yet, but smart candidates should still showcase them strategically. She discusses the three designer archetypes emerging at AI native companies and shares practical advice on standing out when AI can generate portfolios and case studies for everyone. CHAPTERS 00:00 Intro 04:06 AI Skills in Job Descriptions Reality Check 06:52 Research Strategy for AI Portfolio Positioning 14:23 Audience Context Determines AI Skill Positioning17:49 Past Present Future Portfolio Framework 27:10 Common Portfolio Mistakes in AI Era 35:46 Future of AI Skills in Applications 38:39 Favorite Research Interview Techniques RESOURCESLenny’s Podcast featuring Jenny Wen, Design Lead for Claude - https://www.youtube.com/watch?v=eh8bcBIAAFo 2024 AI in User Research Report - https://www.userinterviews.com/ai-in-ux-research-report  CONNECT WITH ANETA KMIECIK: - LinkedIn: Aneta Kmiecik - Instagram: @ux.aneta - Newsletter: Be Your Own Design Team - Portfolio Course: uxportfolio.co

Ben Wiedmaier sits down with user research consultant Nikki Anderson to explore how researchers can stay relevant when budgets are tight and stakeholders are stressed. Nikki runs Drop in Research where she helps teams conduct research, facilitate better meetings, and build research practices from the ground up. She shares how companies are increasingly coming to her with validation requests rather than discovery work, driven by pressure to ship fast and hit numbers. The conversation reveals practical strategies for mixed methods research, using facilitation to drive action from insights, and leveraging AI tools without compromising research quality. Nikki explains why she creates forcing functions to slow stakeholders down when they want to rush into AI features without understanding the problem. She advocates for parallel convergent research design where surveys, interviews, and secondary research happen simultaneously to deliver insights faster. The discussion covers why synthesis remains a bridge too far for AI, how to turn research presentations into collaborative workshops, and specific ways researchers can demonstrate value through facilitation skills. Highlights00:00 Intro05:20 Mixed Methods and Data Triangulation10:07 Finding Small Tests When Teams Won't Wait14:46 Stakeholder Stress Driving Validation Requests23:30 Facilitation as Core Research Skill40:03 Using AI for Research Planning45:39 Demonstrating AI Skills to Stakeholders Resources- AI for User Research 101 Course- 30+ Tools for every phase of UX Research- AI Context Engineering for Research Course

Ben talks with Kristen DeLap, fractional COO at Econify, to explore how UX'ers can build influence without formal authority. Kristen brings a unique perspective, having evolved from interior design to leading product teams at Herman Miller and now working as an operations executive. She shares practical strategies for understanding decision-making processes, translating design work into business impact, and creating the conditions where teams do their best work. They also cover essential skills for today's design professionals, including decision literacy, stakeholder translation, and the art of challenging assumptions diplomatically. Kristen emphasizes that while AI can generate design artifacts, it cannot create alignment across teams or orchestrate complex organizational dynamics. She offers concrete tactics like using customer stories to explain roadmaps, minimizing big presentation moments in favor of ongoing stakeholder engagement, and treating colleagues like users to better understand their motivations and constraints. Highlights 11:08 Design Skills That Can't Be Replaced by AI15:56 Decision Literacy in Organizations21:42 Surprising Realities of Leadership Meetings24:36 Building Influence Without Organizational Power29:01 Storytelling via Roadmaps Exercise35:47 What Trade Off Are You Most Uncomfortable MakingResources A Framework for Decision-Driven ResearchUsing Research Roadshows for InfluenceThe UX Designer's Guide to Research

Erin and Ben chat with Laura Klein, Principal Experience Specialist at Nielsen Norman Group, about the practical realities of AI in user research. Laura teaches a class on AI for researchers and brings a refreshingly balanced perspective to cut through the hype. She explains why those "five simple prompts that will change your life" are mostly nonsense and shares where AI actually works well versus where researchers need to proceed with extreme caution. Laura also shares her green, yellow, and red light framework for AI adoption. She champions AI for tasks like transcription and meta-analysis of old research data, while warning against using it for synthesis and insights generation without serious human oversight. The conversation explores how AI can help teams move faster without sacrificing quality, the importance of collaborative analysis sessions, and why junior researchers need extra guidance when using these tools. This episode offers practical guidance for any researcher trying to separate AI reality from the marketing promises flooding their inbox. Highlights 07:07 Green light, yellow light, red light framework11:59 Framework for deciding when to use AI21:06 Will AI change the researcher role31:23 Focus on what AI makes possible35:17 Skills for advocating against AI hype42:07 AI makes things that look like insightsResources Laura's NN/g AI CourseThe AI in UX Research ReportUsing AI Moderation for Research

Ben sits down with Basel Fakhoury, CEO and Co-founder of User Interviews, and Baran Erkel, Chief Strategy Officer at UserTesting, for a conversation about the research industry's evolution. With AI reshaping customer behaviors and business decisions, both executives emphasize how the need for customer insights has never been greater, even as budget pressures mount across organizations. Basek and Baran share frameworks for executive decision making, explore how AI tools are moving beyond simply replacing human moderators toward creating entirely new research methodologies, and stress that as AI transforms products and experiences over the next few years, customer insights will be fundamental to shaping organizational cultures that keep customers at the center. Highlights 05:15 How research influences corporate strategy12:25 Building effective decision making cultures19:07 Data formats that drive executive decisions26:28 AI everywhere in research tooling landscape29:30 Consolidating insights across teams and tools36:45 Customer centric approach during acquisition integrationResources Read more about the acquisitionThe State of User Research ReportVisual Design for Research Workshop

Ben Wiedmaier sits with Karl Randay, Experience Director at 383, to explore how designers can stay relevant in an increasingly automated world. Karl shares insights from working with major brands like Hilton and Jaguar on digital innovation projects that blend strategy, research, and rapid prototyping. They also talk about the "beige-ification" of design, where templated systems and AI tools risk creating homogeneous experiences across brands. Karl explains how his team uses AI as a research copilot while maintaining human craft and creativity. He also breaks down the skills modern designers need beyond visual craft, including business acumen, stakeholder communication, and the ability to translate design impact into executive language. Highlights 06:26 Design challenges across multiple touchpoints19:04 Simple questions unlock stakeholder priorities25:31 Multi-skilled designers beyond specialization32:23 Career growth through T-shaped skill development36:53 The beige-ification of modern design42:44 AI as creative exploration partnerResources Designer's Guide to UX ResearchThe 4 Steps to Redesigning SitesConnecting Research & Design Leadership

Ben is joined by Maria Rosala from Nielsen Norman Group and John Whalen from Brilliant Experience to wrap up 2025 and make some predictions for 2026. Maria and John share practical insights on everything from AI moderation tools to synthetic users, offering a balanced view of where these technologies excel and where human researchers remain irreplaceable. Maria and John also dig into the democratization of research across product teams, the importance of governance and strategy when implementing AI tools, and how researchers can position themselves as orchestrators of both human and artificial intelligence.  Highlights 08:22 AI tools creating pressure for faster delivery17:18 Governance and oversight for AI implementation24:55 Composite and synthetic users explained41:56 Hiring advice for new researchers44:27 Demonstrating AI proficiency in job applications49:25 Research industry predictions for 2026Resources Research Wrapped 2025The State of User ResearchUltimate UX Jobs Board

Erin May sits down with Kate Towsey, founder of Cha Cha Club and author of Research That Scales, for Research Ops Appreciation Week. Kate shares insights from producing an audio documentary series on the future of research ops, including her fascinating experience co-creating content with AI. She reveals how research ops teams are increasingly surviving layoffs while research teams are cut, explaining that ops professionals focus on unblocking systems and delivering measurable business value rather than gatekeeping processes. Kate emphasizes the critical shift happening in research ops from administrative firefighting to strategic systems design. She discusses the importance of discovery over knee-jerk solutions when building research ops from scratch, advocating for focused problem-solving rather than generic panel and library building. The conversation covers the newly released research ops career ladder, the growing need for strategy skills in the field, and how to effectively communicate value to executives by aligning with existing business priorities and measuring concrete outcomes. Highlights 03:54 Bringing past skills to research ops17:45 AI context and memory limitations26:37 Future vision for strategic research positioning36:28 Quality governance in AI era44:21 Strategy skills gap in research teams50:27 Translating research value to executivesResources Strategy ReferencesKate's MasterclassResearch That Scales (Book)Kate's SubstackThe ResearchOps Review

Ben talks with Lyndsi Lee, UX Manager at Turnitin, about moving beyond traditional metrics like NPS and CSAT to measure user experiences more effectively.  The conversation centers on outcome-based assessment, a framework that breaks user experiences into atomic outcomes. Rather than asking broad satisfaction questions, this approach focuses on specific user goals like "users can complete repetitive tasks without friction." Lyndsi explains how teams can identify these outcomes through existing research and customer feedback, then prioritize them using methods like card sorting with actual users.  The framework helps product teams move away from vague directives and toward specific, measurable improvements that directly impact user success. This episode offers practical guidance for researchers and product teams struggling to demonstrate impact beyond traditional satisfaction scores. Amazon Prime article Highlights 13:49 Complicated Opinion on NPS and CSAT18:51 Outcome Based Assessment Framework27:36 Getting Strategic with Stakeholder Buy-in32:00 Traffic Light System for Stakeholders38:57 Revisiting Outcome Statements Timeline41:40 AI's Role in Quantitative ResearchAbout LyndsiLyndsi is a Senior Manager of UX Research at Turnitin, where she leads efforts to make the student and educator experience more meaningful, measurable, and user-centered. She started her career in public education as a school counselor and School Psychological Examiner, working alongside educators to support students’ learning needs. Eventually, she found her way into UX research, where she combined her love of psychology, education, and technology. Lyndsi is passionate about helping teams stay focused on what truly matters to users, and firmly believes that good research is part art, part science, and part really well-organized sticky notes. Resources Defining UX Success MetricsUX ROI CalculatorGetting Started with Analytics

Ben is joined by Shalin Pei, Head of Design and Research and Natalie Golub, Head of UXR , both from Coinbase's Base product. Base is part of the crypto space, functioning as a network that offers secure and low cost ways to build decentralized apps, essentially helping create what they call the new internet. The conversation reveals how their small but mighty teams operate in one of the fastest moving industries. Shalin and Natalie share how they've weaved internal stakeholders with customers, played with their structure to maximize visibility and effectiveness, and enabled partners to get more involved. It's a practical conversation on the value of experimentation, cooperation, and building influence. Highlights 14:00 Overcoming Impostor Syndrome in New Industries25:37 Embedded Research in Live Design Sprints32:33 The Power of Cross-Functional Collaboration36:21 Documentation Challenges in Fast-Moving Industries40:39 Partner-Led Research Methodology43:33 Future of AI in Design and ResearchResources The Designer's Guide to ResearchAligning Research for More ROIEffective Product > Research Collaboration

Erin is joined by Samira Jain, Serena Hillman, and Jackie Ianni from Microsoft Azure Data to discuss how they built the Swift Research Lab over the past two years. The team shares their systematic five-step approach for creating research programs that result in stakeholder satisfaction while delivering insights every 1.5 weeks. The Azure Data team also break down their method for fostering relationships, building infrastructure and templates, measuring success, and continuously iterating. The discussion reveals how clear branding, stakeholder collaboration, and systematic infrastructure helped them action on high priority research requests while spotting cross cutting insights across Microsoft's product ecosystem. About Our GuestsDr. Serena Hillman is a Principal UX Research Manager in Azure Data at Microsoft. Her work focuses on Human-Data and Human-AI-Data Interaction, leading a team that explores how people engage with data and intelligent systems. She has studied user behavior across domains like video games, e-commerce, edTech, and enterprise cloud tools, and has published 40+ peer-reviewed papers presented at leading conferences and organizations including CHI, CSCW, Grace Hopper, Yahoo!, and Google. Samira Jain is a Senior UX Researcher on the Azure Data UX Team, where she has been for over five years. She leads SWIFT, a cross-team research program, which encompasses several key initiatives. With a foundation in product design, she brings dual fluency to her research practice—understanding why things matter from a user perspective and how they can be shaped from a design perspective. With extensive experience in both non-profit and enterprise research, Samira is dedicated to enhancing experiences for data professionals. Jackie Ianni is a UX Researcher on the Azure Data team at Microsoft, specializing in rapid evaluative and programmatic research. Before joining Microsoft, she worked as a researcher at both an agency and in-house, conducting global financial services research. Jackie is passionate about advancing UX research practice, exploring AI tools, and sparking conversations about the evolving role of research. Highlights 05:47 Five Step Program Development Method09:02 Building Stakeholder Relationships15:39 Continuously Improving Research Programs18:37 Cross Product Insights and Breaking Silos23:24 Collaborative Team Success Formula33:58 AI Tools in Heuristic ReviewsResources Building a UX Research Team from ScratchCreate Long Term Impact with Strong RelationshipsThe Ultimate Guide to UX Research Strategy

Ben sits down with Jake Burghardt from Integrating Research to discuss his new book Stop Wasting Research and how organizations can maximize the product impact of their customer insights. Jake breaks down the critical problem of research waste, where valuable insights from studies get left behind instead of informing future decisions and planning cycles. Jake introduces his framework of three root causes driving research waste: preparation, motivation, and integration. He emphasizes practical solutions like creating insight summaries with stakeholders, building cross-silo research communities, and establishing recurring touchpoints beyond traditional study deliverables. The conversation covers actionable strategies for researchers at all levels, from individual contributors looking to extend their impact to research leaders building organizational initiatives that elevate research as a collective stakeholder voice. Highlights 08:15 Defining research waste and value14:48 Identifying research waste in organizations21:36 Breaking down research silos30:21 Creating insight summary statements37:38 Integration and recurring stakeholder touchpoints42:52 Building research initiatives not individual effortsResources Conducting Better Stakeholder InterviewsThe 2025 State of Research Strategy ReportThe Research ROI & Impact Calculator

The popularity of AI moderation tools, increased attention on "big" data sets (and streams), and the ongoing uncertainty in the research job market have (understandably) led some to wonder about the future of qualitative research. Our guest today, however, is bullish, and explains why. Nancy Baum leads the qualitative research practice at C+R Research. She has nearly 20 years' experience in the field, exposing her to many ebbs and flows. Nancy believes that qualitative practitioners are vital to sifting through the mounds of data, information, and competing interests flooding many companies' attention. Focusing on and uncovering the "Why?" and "How?" still matters today. Listen to learn ways to advocate for qual research, what Nancy thinks of AI-moderation, and how she's developing new researchers. Highlights 09:19 How stakeholders misunderstand qualitative research22:46 AI moderation complements quantitative surveys32:32 Customizing deliverables for stakeholder impact41:09 Flexibility navigates unpredictable human conversations47:49 Deep listening trumps active listening50:26 Early stakeholder conversations secure research valueResources Try our qualitative sample size calculatorThe best qualitative research tools in 2025Qual vs. quant vs. mixed method approaches

In just ten years, ResearchOps has transformed from an obscure Silicon Valley speciality into a vibrant global profession. Despite economic headwinds, ResearchOps roles are emerging across industries far beyond tech, and the field is evolving at breathtaking speed. But where have we come from, and where are we going? In this five-part audio documentary, we’re exploring the past, present, and future of ResearchOps—and it’s exciting, fascinating, and, at times, pretty mindblowing stuff! Each episode features the voices of Cha Cha Club members, senior research leaders, and the smart minds behind User Interviews. In this fifth and final—”awwww”, we hear you say—episode of ResearchOps 2.0, we’re turning the spotlight on the people of ResearchOps: the curious minds, problem-solvers, and system-builders who’ve made this profession what it is today. We’ll explore who they are, where they’ve come from, and what drives them to transform how organisations learn from their users. If you’re a ResearchOps professional, this episode will make you feel seen and heard. If you’re a leader looking to hire a ResearchOps role, this episode will help you think differently about who might hire. And if you’re looking to transition into a ResearchOps career, this episode will give you a great sense of the skills you need and the incredible profession you’ll become a part of.