Advertise on podcast: DataTalks.Club

Tejas Kumar joins Alexey Grigorev to discuss building evaluation datasets, calibrating LLM judges against human preferences, and testing agents beyond their final answers. CHAPTERS 00:00 Podcast intro 00:08 Tejas's path to AI engineering 12:24 Why evals go beyond a manual check 17:37 Sourcing evaluation cases and calibrating a judge 28:33 Refreshing datasets and pinning severe cases 33:10 Judge agreement versus agent performance 50:01 Retraining judges and keeping data fresh 55:59 Human preferences, sample sizes and audience questions 59:46 Evaluating final answers versus the agent's trajectory 1:02:46 Faster judging and further evaluation resources Resources AI evals: https://tej.as/blog/ai-evals-llm-judge Code, demos and slides: https://github.com/TejasQ/basically-agent-evals Tejas: https://tej.as Watch the original recording: https://www.youtube.com/watch?v=oWVmQDqZ7tw Join DataTalks.Club: https://datatalks.club/slack.html

In this talk, Dewang Sultania, ML Engineer at Netflix and co-author of Designing AI Systems, shares his technical journey from building early inference platforms at Adobe to deploying multimodal AI models at scale. We explore the complete architecture of enterprise AI platforms, focusing on evaluation datasets, tool calling orchestration, and the practical realities of shipping production agents. You’ll learn about: - The essential components needed to build an enterprise AI platform from scratch - How traditional software engineers can transition into AI platform engineering - The critical technical differences between session management and LLM memory - Strategies for building, versioning, and trusting custom evaluation datasets - Optimizing LLM tool calling and selecting the right performance benchmarks - When to use multi-agent architectures versus single-agent systems - Techniques for overcoming the lost in the middle problem in RAG pipelines TIMECODES: 00:00 Core Components of Enterprise AI Platforms 11:46 Career Path to AI Platform Engineering 18:33 Session Management Versus LLM Memory Management 26:47 Best Practices for Custom LLM Evaluation Datasets 32:28 LLM Tool Calling Optimization and Benchmark Selection 39:25 Context Window Limits and AI Agent Tool Scaling 45:37 Single-Agent Versus Multi-Agent System Architecture 52:16 LLM-as-a-Judge Alignment and Human Evaluation Strategies 58:11 Solutions for the Lost in the Middle Problem in RAG Systems 01:03:27 Designing AI Systems Book Announcement This discussion is perfect for software engineers, machine learning practitioners, and technical leaders building real-world AI applications. It offers practical insights for anyone transitioning into AI platform engineering or tasked with scaling LLM features for enterprise production. Connect with Dewang: - Linkedin - https://www.linkedin.com/in/dewang-sultania/ - Github - https://github.com/iron-stark Connect with DataTalks.Club: - Join the community - https://datatalks.club/slack.html - Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ - Check other upcoming events - https://lu.ma/dtc-events - GitHub: https://github.com/DataTalksClub - LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Suhas Suresha, Senior Machine Learning Engineer at Adobe and co-author of Designing AI Systems, shares his expertise in building large-scale generative AI infrastructure from deploying real-time ECG analysis models at his previous startup, QALY, to architecting enterprise LLM platforms. We explore the massive engineering effort required to take an AI application from a weekend prototype to a scalable production system, and how to build a unified AI platform that eliminates "AI sprawl." Links: - Book - https://www.manning.com/books/designing-ai-systems - Code - https://github.com/designing-ai-systems/designing_ai_systems_repo You’ll learn about: - The nine core components every production-ready AI platform needs to succeed. - How to solve "AI sprawl" and prevent fragmented engineering efforts across teams. - Architecting scalable Data Services and Model Services for robust LLM applications. - Implementing comprehensive observability and request tracing to identify system bottlenecks. - Managing long-term session memory, tool registries, and complex agent orchestration. - Navigating the "build versus buy" dilemma for enterprise AI infrastructure. TIMECODES: 0:00 AI Prototypes to Production and the Book Origin 5:49 AI Sprawl and the Need for a Centralized AI Platform 12:42 Definition of an AI Platform and the Build vs Buy Dilemma 23:17 AI Platform Engineering Skills and Data Service Architecture 31:26 System Observability and Request Flow Bottlenecks 37:32 LLM Evaluations, Prompt Experimentation, and Cost Tracking 43:57 Session Memory, Tool Registries, and Agent Orchestration 50:56 Invocation Modes and Durable Execution for AI Agents 56:14 The Nine Core AI Platform Components and Memory Management This episode is designed for machine learning engineers, backend developers, and platform architects looking to transition into AI platform engineering. It is highly recommended for technical leaders and teams who need to scale LLM prototypes into reliable, cost-effective production systems. Connect with DataTalks.Club: - Join the community - https://datatalks.club/slack.html - Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ - Check other upcoming events - https://lu.ma/dtc-events - GitHub: https://github.com/DataTalksClub - LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/ Connect with Suhas: LinkedIn - https://www.linkedin.com/in/suhas-suresha/ Twitter - https://x.com/inceptor92 Github - https://github.com/suhas1992 Website - https://suhassuresha.com/

In this talk, Sahil Walia, Senior Technical Architect at Snowflake, shares his extensive data engineering expertise from writing simple SQL queries early in his career to architecting enterprise-scale Apache Iceberg lakehouses today. We explore the evolution of the modern data platform, the mechanics of open lakehouses, and how decoupling storage from compute is transforming data architecture. Links: - https://medium.com/@sahil-walia/ - Iceberg Spec- https://iceberg.apache.org/spec/ - https://ossie.apache.org - https://github.com/Snowflake-Labs/schemachange - https://opensource.guide/how-to-contribute/ You’ll learn about: - What defines a modern data platform and the importance of interoperability. - Key differences between traditional storage, Hive metastores, and Apache Iceberg. - How Iceberg metadata simplifies GDPR compliance, data deletions, and file compactions. - When a lakehouse architecture actually makes sense (and when to avoid it). - Standardizing business logic across compute engines using Apache OSI. - Actionable tips for making impactful open-source data engineering contributions. TIMECODES: 00:00 Defining the Modern Data Platform 11:34 What Exactly is a Lakehouse? 17:20 Comparing Hive Metastore and Apache Iceberg 22:34 Handling GDPR and Data Deletions in Iceberg 27:33 Apache Iceberg vs. Delta Lake 34:10 Do You Need a Lakehouse for Small Data? 40:11 Understanding Apache OSI (Open Semantic Interchange) 49:00 Managing Schema Changes in Data Warehouses 54:20 How to Contribute to Open Source Projects 01:00:40 The Role of AI in Open Source Contributions This talk is designed for data engineers, data architects, and analytics professionals looking to modernize their data infrastructure. It provides essential architectural insights for technical teams evaluating Apache Iceberg, dealing with large-scale data transformation, or aiming to scale their open-source contributions. Connect with Sahil: - Linkedin - https://www.linkedin.com/in/sahilwaliasyracuse - Github - https://github.com/sahil-walia - Website - https://medium.com/@sahil-walia Connect with DataTalks.Club: - Join the community - https://datatalks.club/slack.html - Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ - Check other upcoming events - https://lu.ma/dtc-events - GitHub: https://github.com/DataTalksClub - LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Philip Christos, Associate at M2VC, shares his expertise in frontier AI investing from his early days as a data analyst to evaluating cutting-edge deep tech startups. We explore how AI agents are reshaping modern work, the realities of venture capital in the LLM era, and why the future of software engineering relies more on high-level systems thinking than writing syntax.You’ll learn about:- How venture capitalists formulate AI investment strategies and evaluate startup pitch decks.- The rapid adoption of AI in software engineering compared to traditional sectors like accounting.- The crucial difference between data progress and algorithmic progress in frontier models.- Why LLMs still struggle with high-level software architecture, business logic, and design "taste."- How AI is accelerating iterations and breakthroughs in classical engineering and scientific research.- What specific deep tech and AI infrastructure ideas are actually attracting VC funding today.TIMECODES:00:00 Venture Capital Career Journey05:14 VC Analyst vs Data Analyst Roles10:13 AI Investment Thesis Strategy16:00 Emotion Analytics and Voice AI Startups22:09 LLM Impact on Venture Capital28:19 Software Engineering AI Adoption34:18 Data vs Algorithmic AI Progress40:15 Classical Engineering AI Acceleration46:12 Software Architecture AI Limitations51:11 Future Software Engineering Careers57:55 Systems Thinking in DevOps1:03:00 Pitching Deep Tech StartupsThis talk is perfect for software engineers, AI founders, and technical product managers who want to understand the evolving tech job market and venture landscape. It provides essential insights for anyone looking to build VC-backed AI startups or future-proof their career as AI coding tools become ubiquitous.Connect with Philip- Linkedin - https://www.linkedin.com/in/philipchristos/- Twitter - https://x.com/phil_christos- Website - https://t.me/stacked_channelConnect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Paul Domanski, founder of Domanski AI, shares his unconventional journey from film directing and affiliate marketing to becoming a vibecoder running dozens of autonomous AI agents. We explore the realities of building an agentic operating system, how non technical builders can orchestrate complex AI workflows, and the exact strategies used to close high ticket B2B clients using AI generated prototypes.Links:- Headroom: https://github.com/domanski-ai/headroom/You will learn about:- How to build and use custom workspaces like Demox and Tmux setups to orchestrate over 50 concurrent AI agents- Using automated research and rapid AI prototyping to close high ticket B2B sales- Balancing usage across multiple Claude and Codex accounts while navigating API limits and context windows- How to design audit and deploy complex software solutions without a traditional computer science background or deep knowledge of tech stacks- How the skills of a film director like vision stubbornness and delegation perfectly translate to managing autonomous AI teams- Why evaluating LLM outputs is the most critical skill for ensuring reliable products for enterprise clientsTIMECODES:00:00 Welcome and Showcasing Demox08:46 Paul's Background in Film and Digital Marketing16:09 Sales Pipeline and Client Onboarding22:20 Token Efficiency and Open Source Models31:19 Curiosity and the Learning Process37:52 Red Teaming and Code Audits44:51 Building Software Without Knowing the Tech Stack51:02 Parallels Between Film Directing and Managing AI56:32 Using AI for 3D Printing and Personal Projects01:04:34 The Importance of AI EvalsThis conversation is perfect for solopreneurs, agency owners, and non technical builders who want to move beyond basic chat interfaces and start leveraging autonomous AI agents for real world business operations. Whether you are transitioning into AI from marketing, project management, or creative fields, this episode offers a practical blueprint for turning AI curiosity into a scalable business.Connect with Paul:- Linkedin - https://www.linkedin.com/in/paul-domanski-ai/- Twitter - https://x.com/domanski_ai- Github - https://github.com/domanski-ai- Website - https://domanski.ai/Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Tony Zeljkovic, Founder of Narona Data, shares his unconventional career journey from bioinformatics research and clinical genetics to building a successful AI and data platform consulting business. We explore the essential soft skills, networking strategies, and business mindsets required to thrive as an independent data consultant in today’s rapidly shifting tech landscape.Links:- The book pre-order on packt - https://www.packtpub.com/en-us/product/the-data-consultants-handbook-9781806665266- The book pre-order on amazon - https://www.amazon.com/dp/B0H3TBWHH1?lv=shuf&channelId=500&plpRedirect=mhFallbackYou’ll learn about:- How to smoothly transition from a highly technical or academic role into independent data consulting.- The step-by-step process of building a strong digital footprint and growing a reliable client pipeline from scratch.- Strategic positioning: how to stop selling "data engineering" and start selling business outcomes and ROI.- How leveraging platform implementation partnerships (e.g., Snowflake, dbt) can help you land your first major clients.- Adapting to the AI era and ensuring your consulting services stay relevant as market demands change.- The business mindset of a consultant, including when to invest in tools and outsource tasks like accounting to accelerate your growth.TIMECODES:00:00 Landing the First Consulting Client via Academic Research06:06 Transitioning from Research to Consulting11:42 Becoming a Platform Implementation Partner18:20 Building Your Digital Footprint23:22 Positioning: Selling Business Outcomes vs. Technical Skills31:02 Networking Strategies and Finding Industry Pain Points37:24 Is Consulting Right For You?44:17 Adapting to AI and Changing Market Demands50:16 Business Mindset: Investing in Tools and Outsourcing55:52 Start Early and Pay It Forward1:02:37 The Practical Handbook for Data ConsultingThis talk is perfect for data engineers, analytics professionals, and software developers who are considering the leap into freelancing or starting their own consulting practice. It is highly valuable for technical experts who want to master client acquisition, stakeholder communication, and the business side of the data industry.Connect with Tony:- LinkedIn - https://www.linkedin.com/in/tony-zeljkovic/- GitHub - https://github.com/2tony2- Consulting website - https://www.naronadata.com/​Connect with Juan:- LinkedIn - https://www.linkedin.com/in/jmperafan/- GitHub - https://github.com/jmperafan- Consulting website - https://juanalytics.com/Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Radovan Bacovic, Principal Data Engineer and Snowflake/dbt Ambassador, shares his two-decade journey, from traditional database administration to leading modern data platform engineering. We explore the essential building blocks of scalable data architectures, the trade-offs of no-code solutions, and how to effectively integrate AI into your data pipelines while maintaining strict security and governance. You’ll learn about: - The evolution of the full-stack data engineer over the past two decades. - Building scalable, business-driven data platforms without premature optimization. - Efficient data modeling and transformation using DuckDB and dbt. - Leveraging AI to accelerate pipeline development and launch data products. - Implementing enterprise data governance and robust pipeline security.- Balancing no-code integration tools with strict DataOps methodologies. LINKS: https://gitlab.com/radovan.bacovic/wsc26_dataops/-/blob/main/README.md?ref_type=heads TIMECODES: 0:00 Data Engineering Career Trajectory and Industry Experience 6:37 Full Stack Data Engineer Role Evolution and Responsibilities 14:45 Scalable Data Platform Architecture and Business Alignment 21:59 DuckDB Integration and Premature Database Optimization Avoidance 30:04 Data Pipeline Transformation and Data Modeling with dbt 35:31 Modern Data Platform Ecosystem and Infrastructure Orchestration 42:13 AI Powered Data Products and LLM Pipeline Automation 49:42 Enterprise Data Governance and Pipeline Security Best Practices 55:06 No Code Data Integration Tools and DataOps MethodologyThis talk is ideal for data engineers, analytics engineers, and data platform leads looking to modernize their tech stacks and future-proof their infrastructure. It provides highly actionable insights for anyone aiming to build resilient, AI-ready data platforms that prioritize real business value and strict security constraints. Connect with Radovan - Twitter - https://x.com/SvenMurtinson - Linkedin - https://www.linkedin.com/in/radovanbacovic/ - Github: https://gitlab.com/radovan.bacovic/ - Website: www.bacovic.com Connect with DataTalks.Club: - Join the community - https://datatalks.club/slack.html - Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ - Check other upcoming events - https://lu.ma/dtc-events - GitHub: https://github.com/DataTalksClub - LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Paul Iusztin, Creator of Decoding AI and author of the LLM Engineer's Handbook, shares his deep expertise in personal automation from managing a digital life with lightweight data pipelines to architecting autonomous agents for deep research. We explore the mechanics of building personal AI assistants and the critical role of using a "second brain" as a context layer over heavy, over-engineered RAG infrastructure.You’ll learn about:- Organizing your digital life using the PARA method and lightweight data pipelines.- Capturing and retrieving resources effortlessly with Obsidian, Readwise, and custom deep research algorithms.- Leveraging your "second brain" setup as the ultimate context layer for personal AI assistants.- Generating ad-hoc wikis from markdown brain dumps to streamline content creation and research.- Optimizing AI-generated content by deliberately lowering LLM reasoning capabilities for better styling.- Adapting multi-agent workflows and personal wikis to accelerate software engineering and coding tasks.TIMECODES:00:00 Digital life organization using the PARA method and lightweight data pipelines05:21 Seamless resource capture with Obsidian and Readwise09:26 Resource retrieval optimization using a deep research algorithm12:44 High-quality internet curation versus heavy RAG pipelines16:31 Second brain setup as a context layer for personal AI assistants21:40 AI workflow simplification with Anthropic APIs and CLI tools25:26 Ad-hoc wiki generation from markdown brain dumps for content creation29:18 Codebase ingestion and web scraping proxy tool workarounds34:43 Resource reranking and context window management for large texts39:06 Content styling optimization by lowering LLM reasoning capabilities46:18 Multi-agent workflows and personal wikis for software engineering tasks52:32 Personal wiki scaling for enterprise knowledge bases and book writingThis talk is perfect for individual developers, AI engineers, and knowledge workers looking to escape "PoC purgatory" and build practical, low-maintenance personal AI assistants. It offers highly actionable insights for anyone wanting to integrate agentic workflows into their daily productivity systems without over-engineering their tech stack.Connect with Paul- Linkedin - https://www.linkedin.com/in/pauliusztin/- Website - https://www.pauliusztin.ai/Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Maryam Ramezani-Bartsch, Data and AI Leader with over 20 years of experience at companies like adidas and Zalando, shares her extensive career journey from building foundational ML systems at adidas to coaching data experts through the modern AI landscape. We explore the critical intersection of technical strategy and the essential human skills needed to thrive in the AI era.LINKS:- https://maryamramezani.com/designyourdatacareerYou will learn about:- The surprising similarities and critical differences between the current Generative AI boom and the previous Big Data era.- Why the traditional boundaries between data roles are disappearing and the specific T shaped profile companies are actually hiring for today.- The hidden danger of perfectionism in corporate tech, and what a healthy margin of failure actually looks like in practice.- How to stop leaving your career trajectory to chance by applying product Design Thinking to your own life.- A practical framework for navigating industry uncertainty and tech career anxiety without burning out.- Battle tested strategies for regaining your footing and standing out in a highly competitive job market after a layoff.- The specific non technical human skills that will become your ultimate career moat against automation.TIMECODES:00:00 Human Skills in the AI Era07:07 Building ML Systems at Adidas12:49 Generative AI vs Big Data Era18:39 T-Shaped Data Engineering Roles24:04 Overcoming Perfectionism in Tech30:34 Design Thinking for Data Careers38:59 Managing Tech Career Anxiety45:07 Aligning Passion with Tech Skills50:18 Job Search Strategies After Layoffs56:03 Essential Soft Skills for JuniorsThis talk is essential for data professionals, software engineers, and tech leaders looking to future proof their careers in an increasingly automated world. Whether you are a junior developer navigating a tough job market, an engineer bouncing back from layoffs, or a senior professional looking to strategically design your next pivot, this session provides the tools to build a highly resilient career.Connect with Maryam- Linkedin - https://www.linkedin.com/in/maryam-ramezani-bartsch/- Website - https://maryamramezani.com/- Substack - https://maryamramezani.substack.com/Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Gustaf Gyllensporre, Senior AI Engineer and PropTech Founder, shares his unconventional career journey from selling Miami real estate to shipping production AI systems. We explore the tactical steps for breaking into the tech space as a self taught developer and how to successfully bypass traditional industry gatekeepers.Links:-  @PropTechFounder  - https://youtu.be/leXRiJ5TuQo?si=ymK03qKVEC7hAt9N- https://x.com/gostak_ddYou will learn about:- The strategic approach to crafting an AI engineering resume that actually gets noticed by hiring managers.- Why building another generic RAG chatbot might be hurting your portfolio and the specific high impact projects you should build instead.- The massive difference between interviewing for AI roles at dynamic startups versus traditional big tech companies.- How to leverage open source contributions to prove your technical mastery without a computer science degree.- The surprisingly simple networking tactics and developer ambassador programs that can unlock exclusive job opportunities.- Actionable ways to improve the critical social and communication skills that most developers completely ignore.TIMECODES:00:00 AI Engineering Field Guide05:01 Self Taught AI Engineer Pivot09:39 CPython Open Source Contributions13:49 Tech YouTube Channel Growth18:26 AI Engineer Resume Optimization22:44 AI Engineering Portfolio Projects29:23 Startup vs Big Tech Interviews33:47 Open Source AI Project Ideas38:55 Building Deep Research AI Agents42:52 Landing Your First AI Job46:48 Tech Networking Strategies51:16 Technical Project Demo Videos54:53 Self Taught Developer Mistakes58:53 Soft Skills for Software EngineersConnect with Gustaf- Linkedin - https://www.linkedin.com/in/gustaf-g/Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/

In this talk, Aleksandr Kim, Senior Data Scientist at Intuit, shares his expertise in building AI-powered features in production from fine-tuning BERT models in cyber security to engineering scalable data verification platforms. We explore the reality of moving beyond messy research code to build observable, cost-effective AI agents and automated pipelines.You’ll learn about:- Translating traditional machine learning metrics into actionable business outcomes- Validating large language model behavior through robust evaluation and alignment techniques- Pivoting from a generic chatbot project to high-value Slack automation workflows- Structuring outputs and guided reasoning layers to eliminate trivial AI summaries- Defining the overlapping skills between AI engineers, data scientists, and full-stack software engineers- Implementing multi-LLM routing logic and token caching to minimize enterprise API expenses- Identifying critical data infrastructure bottlenecks to determine when to pivot or drop an AI pilotTIMECODES:00:00 AI Engineering Production and Scalability06:12 Intuit Ecosystem and QuickBooks Products12:17 Aligning ML Metrics with Business Outcomes18:52 AI Engineers Conducting Customer Interviews25:13 Structured Output and Guided Reasoning31:13 Defining AI Engineering vs Software Engineering37:20 Cost Optimization and Multi LLM Routing43:26 UI Trends and Token Management in Industry49:33 Future Career Trends in AI Engineering55:46 Data Infrastructure Bottlenecks and ML FailuresThis session is designed for mid-to-senior level Data Scientists, Machine Learning Engineers, and Software Engineers who want to develop a highly practical, production-first approach to generative AI. It is especially useful for technology leads focused on reducing token overhead and building self-correcting agentic systems.Connect with Aleksandr- Website - https://alexkimds.github.io/- Linkedin - https://www.linkedin.com/in/aleksandrkim/

In this talk, Ivan, Senior Engineering Manager at Personio, shares his deep expertise in the data and software space from his early days building traditional NLP systems and massive ETL pipelines to his current leadership role in Identity and Access Management (IAM). We explore the rapid evolution of Generative AI, the reality of managing AI agents in production, and the emerging field of context engineering to optimize developer workflows.You’ll learn about:- The buy vs. build dilemma for AI infrastructure and local LLMs.- How AI agents are shifting workloads and evolving code reviews.- Why AI is currently better at fixing tech debt than building from scratch.- Measuring the ROI of AI integration using DORA metrics and cycle times.- Strategies to manage vendor lock-in and minimize AI provider dependency.- Using "context engineering" and specification-driven development to maximize LLM quality.- Why hiring junior engineers is still essential and how AI accelerates their onboarding.TIMECODES:00:00 Career Journey in Data Science and NLP07:37 Industry Adoption of Generative AI and Agents11:45 Buy vs Build Dilemma for AI Infrastructure15:46 AI Capability Limits in Fixing Tech Debt19:32 Developer Workloads and AI Code Contributions24:49 Experimentation with Open Source AI Agent Architectures30:06 Measuring ROI and Business Value of AI Integration35:10 Tracking AI Impact Using DORA Metrics39:51 Impact of AI Code Generation on CI/CD System Reliability43:00 Best Practices for Team AI Tool Adoption48:20 Managing Vendor Lock-In Risks with AI Providers51:27 Importance of Hiring Junior Software Engineers56:28 Accelerated Junior Developer Onboarding with AI Assistants01:00:12 Specification-Driven Development and Context EngineeringThis talk is perfect for software engineers, engineering managers, and technical leaders looking to practically integrate AI tools into their teams without sacrificing code quality or system reliability. It is especially valuable for tech professionals navigating the complexities of AI adoption, CI/CD pipeline management, and organizational scaling in the GenAI era.Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/ Connect with Ivan:- LinkedIn - https://www.linkedin.com/in/ivan-bilan/ - Twitter - https://x.com/demiourgosua - Github - https://github.com/ivan-bilan - Website - https://github.com/ivan-bilan

The conference highlighted a critical shift in the technology and engineering ecosystem, moving away from passive implementations toward autonomous AI systems, collaborative communities, and robust engineering guardrails. Discussions centered on the practical architecture required to scale AI safely, the evolution of modern developer tools, and the importance of cross-border technical collaboration. Ultimately, the insights underscored that the future of technology relies on blending rigorous infrastructure with human-centric ecosystem growth. Florian Hönicke an expert in engineering infrastructure, explored the operational shifting of cloud services and the challenges of secure temporary access provisioning. He detailed strategies for managing transient credentials for large groups and autonomous agents using automated serverless functions without exposing long-lived access keys. His central thesis argues that true engineering rigor requires deterministic, self-expiring security layers at the container level. Stella Buhalis, a technical community and developer relations leader, addressed the human dynamics fueling open-source ecosystems and community-driven adoption. She emphasized that long-term project viability stems from structured developer onboarding and lower cognitive barriers rather than pure marketing outreach. Her key insight is that building trusted technical communities acts as the ultimate feedback loop for improving developer experience and software reliability. Błażej Nowakowski, a backend systems architect, focused on database migration paradigms and the optimization of high-dimensional vector search at the network edge. He analyzed real-world infrastructure friction points, specifically isolating SQLite database lock conflicts and remote data sync latencies on serverless architectures. He noted that decoupling persistent remote backends from the core runtime is crucial for maintaining low-latency, multi-cloud application performance. Alena Astrakhantseva, a talent strategy and engineering education specialist, outlined the rapid evolution of technical training as the industry shifts from traditional development to autonomous AI flows. She analyzed how continuous testing, real-time monitoring, and structured evaluation frameworks must become core competencies for new developers. Her notable perspective highlights that the next wave of technical talent must be hired for systemic engineering rigor over simple syntax mastery. Zhen Ming Ng (Babypro), an open-source library maintainer and developer, demonstrated automation workflows for package deployment and baseline library compliance. He focused on minimizing framework overhead by substituting heavy, resource-intensive dependencies with lightweight tokenizers and compact client drivers. His core perspective is that library design must prioritize minimalism to remain functional across edge-native runtime environments. Connect with speakers: Florian HönickeCloud Infrastructure & DevOps Engineer Specialisthttps://www.linkedin.com/in/florian-h%C3%B6nicke-b902b6aa Stella BuhalisDeveloper Relations & Technical Community Leadhttps://www.linkedin.com/in/stella-buhalis Błażej NowakowskiBackend Systems Architect & Database Engineerhttps://www.linkedin.com/in/b%C5%82a%C5%BCej-nowakowski-096716168/ Alena AstrakhantsevaTechnical Talent Strategist & Engineering Educatorhttps://www.linkedin.com/in/alenaastra/ Zhen Ming Ng (Babypro)Open Source Software Maintainer & Core Developerhttps://www.linkedin.com/in/ming91/

In this talk, Nikita, Senior Applied Data Scientist at the AWS Generative AI Innovation Center, shares his expertise in bringing enterprise artificial intelligence out of the sandbox—from his early days optimizing traditional machine learning models like gradient boosting to deploying advanced production-grade GenAI pipelines. We explore what it really takes to move generative AI systems from pilot prototypes to production environments.Links:- AWS Generative AI Innovation Center: https://aws.amazon.com/ai/generative-ai/innovation-center/You’ll learn about:- Deploying multi-layered defenses independent of backend LLMs.- Evaluating parameter-efficient methods like LoRA and QLoRA for small models.- Balancing long-term domain expertise with real-time documentation retrieval.- Utilizing multi-agent orchestration for search and anomaly explanation.- Setting up robust LLM-as-a-judge frameworks verified by human metrics.- Leveraging Amazon Bedrock components for memory and runtime scalability.TIMECODES:05:52 Shifting from traditional ML to generative AI07:49 Hybrid pipelines blending classical ML and LLMs11:25 Production guardrails and multi-layered system defense16:15 Prompt bypasses, input attacks, and AI red teaming20:49 Newsletter localization and translation with Zalando27:24 Evaluation frameworks and human-in-the-loop metrics33:07 Aligning LLM-as-a-judge with few-shot prompts34:49 Fine-tuning small language models versus prompting41:18 Complementary mechanics of RAG and fine-tuning43:00 Agentic web search tools for anomaly explanation47:01 Automated text generation from real-time sports sensors49:58 AWS project scoping and proof of concept timelines54:58 Interview requirements and career skills for AWS roles57:59 Enterprise architecture patterns and system observability01:00:42 Reusable infrastructure blocks on Amazon BedrockThis session is designed for machine learning engineers, data scientists, and technical product managers looking to architect reliable, production-ready GenAI workflows. It is highly valuable for teams aiming to bridge the gap between experimental AI prototypes and secure enterprise software.Connect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/ Connect with Nikita- Linkedin - https://www.linkedin.com/in/kozodoi/- Github - https://github.com/kozodoi- Website and blog - https://www.kozodoi.me/