1698547467
Data Science Tech Brief By HackerNoon

Advertise on podcast: Data Science Tech Brief By HackerNoon

Rating
★★★★★
5
from
1 reviews
This podcast has
100 episodes
Language
English
Publisher
HackerNoon
Explicit
No
Date created
2023/07/20
Latest episode
2026/11/03
Average duration
13 min.
Release period
1 days

Description

Learn the latest data science updates in the tech world.

Unlock Data Science Tech Brief By HackerNoon podcast Email contact info,
Listeners & Audience details

Email contact information

Direct podcast contact details

Listeners

Audience numbers & engagement insights

Audience details

Podcast Insights

Podcast episodes

Check latest episodes from Data Science Tech Brief By HackerNoon podcast


Sampling Ad Exchange Events at Scale: What We Kept, What We Dropped, and Why
2026/11/03
This story was originally published on HackerNoon at: https://hackernoon.com/sampling-ad-exchange-events-at-scale-what-we-kept-what-we-dropped-and-why. How we reduced Kafka stream volume by 80%, cut Spark workers from 240 to 30, and lowered reporting costs through sampling and executor tuning at Unity. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-engineering, #apache-kafka, #apache-spark, #big-data, #data-pipelines, #adtech, #cloud-cost-optimization, #data-sampling-techniques, and more. This story was written by: @vikrantbachhav. Learn more about this writer by checking @vikrantbachhav's about page, and for more stories, please visit hackernoon.com. At Unity, our ad exchange was processing approximately 10 GB of Kafka event data per second, much of which wasn't needed for downstream reporting. By introducing auction-level sampling, retaining critical events at full fidelity, and optimizing Spark executor configurations, we reduced stream volume by 80%, cut Spark workers from 240 to 30, and lowered DSP reporting transform costs by approximately 41%. Along the way, we uncovered longstanding reporting inaccuracies and learned why understanding data usage is just as important as optimizing infrastructure.
83 Blog Posts To Learn About Metrics
2026/11/02
This story was originally published on HackerNoon at: https://hackernoon.com/83-blog-posts-to-learn-about-metrics. Learn everything you need to know about Metrics via these 83 free HackerNoon blog posts. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #metrics, #learn, #learn-metrics, and more. This story was written by: @learn. Learn more about this writer by checking @learn's about page, and for more stories, please visit hackernoon.com.
Why Your Python Cache Does the Same Work Twice (P.S: GIL Won’t Save You)
2026/11/02
This story was originally published on HackerNoon at: https://hackernoon.com/why-your-python-cache-does-the-same-work-twice-ps-gil-wont-save-you. Your Python cache can run the same work twice, even with the GIL. See the check-then-act race, the lru_cache gotcha, and how locks fix it. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #python-programming, #python-threading, #race-conditions, #python-gil, #thread-safety, #python-concurrency, #hackernoon-top-story, and more. This story was written by: @sohelalam79. Learn more about this writer by checking @sohelalam79's about page, and for more stories, please visit hackernoon.com. A cache that checks "is this key missing?" and then computes the value can run the same work many times when threads interleave, even with the GIL, because the GIL protects the interpreter, not your two-step logic. Hold one lock around the check and the work, ideally one lock per key.
AI-Assisted Reconciliation of Enterprise Data: Detecting and Explaining Cross-Platform Discrepancies
2026/10/31
This story was originally published on HackerNoon at: https://hackernoon.com/ai-assisted-reconciliation-of-enterprise-data-detecting-and-explaining-cross-platform-discrepancies. Learn how deterministic checks and AI work together to detect data discrepancies, explain their causes, and simplify financial reconciliation. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-engineering, #data-quality, #ai, #data-reconciliation, #lakehouse, #data-science, #data-regulations, #ai-assisted-reconciliation, and more. This story was written by: @ajaysikharam. Learn more about this writer by checking @ajaysikharam's about page, and for more stories, please visit hackernoon.com. Learn how deterministic checks and AI work together to detect data discrepancies, explain their causes, and simplify financial reconciliation.
REPL While It Works: Inspect a Running Python Program Without Pausing It
2026/10/30
This story was originally published on HackerNoon at: https://hackernoon.com/repl-while-it-works-inspect-a-running-python-program-without-pausing-it. Use the python REPL or debugger console while a program is running, without interrupting or pausing execution. Exploit threading multitasking. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #python-programming, #python-developers, #repl, #python-pdb, #python, #python-inspection, #debugging, #coding, and more. This story was written by: @dakra. Learn more about this writer by checking @dakra's about page, and for more stories, please visit hackernoon.com. Usually, without interrupting it, you cannot interactively debug, call functions in, or change the values of variables in a running python program. This article’s technique removes the limitation.
When a Dashboard Looks Perfect but the Data Is Wrong
2026/10/30
This story was originally published on HackerNoon at: https://hackernoon.com/when-a-dashboard-looks-perfect-but-the-data-is-wrong. Data definitions are crucial for accurate metrics, and their absence can lead to believable but wrong numbers that nobody questions. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-science, #data-engineering, #data-analytics, #data-visualization, #data-governance, #data-testing, #automated-data-testing, #business-intelligence, and more. This story was written by: @kkj-data. Learn more about this writer by checking @kkj-data's about page, and for more stories, please visit hackernoon.com. Data definitions are crucial for accurate metrics, and their absence can lead to believable but wrong numbers that nobody questions. Centralizing definitions and putting business logic in versioned, tested models can prevent metric disputes and ensure trust in data-driven decisions.
No One Holds the Key: Threshold ECDSA, Part 1
2026/10/29
This story was originally published on HackerNoon at: https://hackernoon.com/no-one-holds-the-key-threshold-ecdsa-part-1. A deep dive to threshold elliptic curve digital signature algorithm (ECDSA) and its building blocks: oblivious transfer, MtA, OT-based protocol. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #multi-party-computation, #ecdsa, #oblivious-transfer, #cryptography, #distributed-key-generation, #elliptic-curve-cryptography, #crypto, #hackernoon-top-story, and more. This story was written by: @privatekeypirate. Learn more about this writer by checking @privatekeypirate's about page, and for more stories, please visit hackernoon.com. Threshold ECDSA lets t-of-n parties produce a standard ECDSA signature without anyone ever holding the full private key. Part 1 covers ECDSA basics and nonce pitfalls, commitment-based DKG that blocks rogue-key attacks, the history of threshold ECDSA, the HLNR18 protocol’s trade-offs, and OT-based multiplication.
OData at Scale: When to Use CDS Views, RAP, or API Business Hub in Hybrid SAP
2026/10/29
This story was originally published on HackerNoon at: https://hackernoon.com/odata-at-scale-when-to-use-cds-views-rap-or-api-business-hub-in-hybrid-sap. Choose between CDS-view OData, custom RAP services, and API Business Hub in hybrid SAP landscapes, with Cloud Connector, security, and performance trade-offs. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data, #api-development, #hybrid-cloud, #enterprise-technology, #rap, #cds, #odata, #odata-at-scale, and more. This story was written by: @anupbharti. Learn more about this writer by checking @anupbharti's about page, and for more stories, please visit hackernoon.com. Hybrid SAP OData is three decisions, not one: CDS views for read-heavy Fiori/analytics, RAP for anything beyond CRUD, and API Business Hub when an external party is involved — used together. Across the Cloud Connector, tuning changes: cache metadata, watch $expand size, prefer $select calls over deep expands. Propagate identity per user with short-lived certificates, not a shared technical user. A read view rarely stays internal — revisit governance and write questions as it gains consumers.
Your Drift Dashboard Can Be Green While Your Model Is Failing
2026/10/28
This story was originally published on HackerNoon at: https://hackernoon.com/your-drift-dashboard-can-be-green-while-your-model-is-failing. Build a Python drift monitor with SciPy and Evidently, then test five scenarios showing why data drift doesn't always mean model performance is degrading. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-drift-detection, #ai-data-documentation, #model-degradation, #python-scipy, #concept-drift, #credit-risk-modelling, #ml-model-calibration, #mlops, and more. This story was written by: @davidtaiwobalogun. Learn more about this writer by checking @davidtaiwobalogun's about page, and for more stories, please visit hackernoon.com. Using a synthetic credit-risk model, the author builds a drift-monitoring pipeline with SciPy, pandas, and Evidently and tests it across five controlled scenarios. The results demonstrate that harmless distribution changes can trigger alerts, genuine risk shifts may not require retraining, and concept drift can degrade performance without changing input distributions. The article proposes a monitoring approach combining statistical drift, prediction changes, data-quality checks, and delayed outcome evaluation.
Why Faster Algorithms Aren't Enough to Build High-Performance Data Platforms
2026/10/28
This story was originally published on HackerNoon at: https://hackernoon.com/why-faster-algorithms-arent-enough-to-build-high-performance-data-platforms. Why some tables should never exist: how a data engine cuts copies, memory use, and wasted CPU, from node-to-node access to what the browser actually draws. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-engineering, #software-architecture, #performance-optimization, #memory-management, #parallel-computing, #in-memory-computing, #data-visualization, #good-company, and more. This story was written by: @megaladata. Learn more about this writer by checking @megaladata's about page, and for more stories, please visit hackernoon.com. High-performance data processing depends on more than efficient algorithms or powerful hardware. Drawing on decades of analytical platform development, the Megaladata team explains how data representation, lazy evaluation, reduced copying, specialized memory allocators, and parallel execution influence system performance. The article also explores the trade-offs of Python multiprocessing and the importance of optimizing data transfer and visualization in the browser, arguing that performance must be designed across the entire data lifecycle.
Why Modern Data Lakehouses Fail at Scale: The Metadata Problem Nobody Talks About
2026/10/25
This story was originally published on HackerNoon at: https://hackernoon.com/why-modern-data-lakehouses-fail-at-scale-the-metadata-problem-nobody-talks-about. Explore why modern data lakehouses slow down at scale and how metadata growth, small files, partitioning, and maintenance affect Iceberg and Delta Lake. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-engineering, #data-lakehouse, #apache-iceberg, #delta-lake, #metadata-management, #modern-data-lakehouses, #scalability, #hackernoon-top-story, and more. This story was written by: @adiranjan25. Learn more about this writer by checking @adiranjan25's about page, and for more stories, please visit hackernoon.com. Modern data lakehouses promise scalable storage, flexible analytics, and efficient processing, but performance can deteriorate as datasets grow. The problem is often not insufficient compute—it is unmanaged metadata, excessive small files, inefficient partitioning, and costly maintenance operations. This article explores how Apache Iceberg, Delta Lake, and other lakehouse technologies handle metadata, why conventional optimization strategies may fall short, and how workload-aware maintenance can improve performance and cost efficiency. The key takeaway: scaling storage is easy; scaling metadata management requires deliberate architectural decisions.
The Hidden Cost of Real-Time Data: Why Faster Pipelines Don't Always Deliver Better Decisions
2026/10/25
This story was originally published on HackerNoon at: https://hackernoon.com/the-hidden-cost-of-real-time-data-why-faster-pipelines-dont-always-deliver-better-decisions. Explore the hidden costs of real-time data pipelines and learn why latency, data freshness, correctness, and recovery matter in Kafka and streaming architecture Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-engineering, #real-time-data, #apache-kafka, #stream-processing, #data-pipelines, #distributed-systems, #data-architecture, #data-quality, and more. This story was written by: @adiranjan25. Learn more about this writer by checking @adiranjan25's about page, and for more stories, please visit hackernoon.com. Real-time data pipelines are not just about speed. Even when events are processed in milliseconds, late arrivals, duplicate records, stale data, and recovery failures can lead to incorrect business decisions. This article explores the hidden costs of streaming architectures and explains why data freshness, correctness, fault tolerance, and operational efficiency matter as much as low latency. It also introduces a practical framework for designing reliable, production-ready streaming systems using technologies like Apache Kafka and CDC.
On November 1, Your 24/7 Dashboard Will Report a 25-Hour Day
2026/10/23
This story was originally published on HackerNoon at: https://hackernoon.com/on-november-1-your-247-dashboard-will-report-a-25-hour-day. Malek Damiri on why 24/7 dashboards report a 25-hour day when clocks fall back on Nov 1, and a calendar-table SQL fix for DST. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #data-analytics, #sql, #daylight-saving-time, #time-zones, #business-intelligence, #data-engineering, #crypto, #dashboards, and more. This story was written by: @malekdamiri. Learn more about this writer by checking @malekdamiri's about page, and for more stories, please visit hackernoon.com. Any business that runs around the clock but reports by local calendar day gets a 25-hour day when clocks fall back (November 1 in the US, October 25 in Europe) and a 23-hour day in March. Revenue operations lead Malek Damiri shows the 4% phantom swing it creates, three bugs that make it worse, and a calendar table with hours_in_day that fixes it, using runnable DuckDB and Snowflake SQL.
How to Solve Blind Spots in Your Architecture by Building a Production-Grade Uptime SaaS
2026/10/22
This story was originally published on HackerNoon at: https://hackernoon.com/how-to-solve-blind-spots-in-your-architecture-by-building-a-production-grade-uptime-saas. In this article, I will walk you through how I designed, built, and tested a production-grade Uptime & API Health Monitor Micro-SaaS entirely in Python. Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #python-programming, #software-engineering, #rest-api, #python, #devops, #backend, #authentication, #architecture, and more. This story was written by: @himashitech6978. Learn more about this writer by checking @himashitech6978's about page, and for more stories, please visit hackernoon.com. A developer can build their own uptime monitoring service using Python, instead of paying for a third-party service, by following a tutorial that walks through designing, building, and testing a production-grade micro-SaaS. The service features asynchronous health checks, background scheduling, database persistence, and enterprise-grade JWT authentication, all wrapped up in a clean FastAPI backend.
One Rogue pip install Away from a Breach
2026/10/22
This story was originally published on HackerNoon at: https://hackernoon.com/one-rogue-pip-install-away-from-a-breach. Stop Using pip Install Blindly: Securing Your Python Supply Chain in 2026 Check more stories related to data-science at: https://hackernoon.com/c/data-science. You can also check exclusive content about #python-programming, #secure-software-development, #secure-infrastructure, #supply-chain, #software-engineering, #software-development, #backend-development, #pip-install, and more. This story was written by: @himashitech6978. Learn more about this writer by checking @himashitech6978's about page, and for more stories, please visit hackernoon.com. To secure your Python application, use deterministic builds with tools like Poetry or pip-tools to lock exact versions and cryptographic hashes. Automate vulnerability scans in your CI/CD pipeline with tools like pip-audit or Safety to catch CVEs before deployment.

Podcast reviews

Read Data Science Tech Brief By HackerNoon podcast reviews


5 out of 5
1 reviews
★★★★★
L1f3r2 2023/08/29
Data science stories on the go!
LFG
check all reviews on apple podcasts

Podcast sponsorship advertising

Start advertising on Data Science Tech Brief By HackerNoon relevant audience podcasts


What do you want to promote?