> writing
The DataAI Chronicles
Practical guidance on real-time data, Snowflake and FinOps for AI.
52 articles
Archive
All articles
52 articles
2026
The Quietest Process in Airflow: What the Triggerer Did for 200 Parallel Dataproc Jobs (opens in a new tab)
big datagoogle cloud platformkubernetes
7 min
Connecting Atlan to Snowflake’s Ontology: Tags, Lineage, and Semantic Views Across the Boundary (opens in a new tab)
data engineeringontologydata governance
10 min
The Semantic Layer: Semantic Views, dbt Metrics, and Business Definitions (opens in a new tab)
data engineeringdata governancedbt
7 min
Governance as Ontology: Tags, Policies, and Horizon Catalog (opens in a new tab)
data governanceontologysnowflake
7 min
One Skills Repo, Every AI Agent: How Our Data Team Ships Its Conventions to Claude Code, GitLab Duo, OpenCode, and Snowflake CoCo (opens in a new tab)
open codesnowflake cortexgitlab
9 min
Your Data Pipeline Shouldn’t Require a PhD in YAML (opens in a new tab)
analytics engineeringsnowflakedata pipeline
12 min
Domain Modeling in Snowflake: Databases as Domains, Schemas as Contracts (opens in a new tab)
data modelingdbtontology
7 min
The Autoscaler That Never Fired. (opens in a new tab)
data engineeringdevopsdebugging
10 min
The Iceberg Catalog Layer Explained: Snowflake Horizon, Open Catalog, Polaris, Glue and Nessie Compared (opens in a new tab)
data engineeringapache polarisapache iceberg
16 min
One Runner, Many Projects: Self-Hosted GitLab CI on GKE (opens in a new tab)
gitlab ci runnerdata engineeringgitlab
9 min
The Architecture: How Ontology Layers Stack on Snowflake (opens in a new tab)
5 min
Your Favorite Database Just Moved Into Snowflake’s House (opens in a new tab)
14 min
What Is Ontology in a Data Platform? You Already Have One. It’s Just Bad. (opens in a new tab)
5 min
Postgres Data Mirroring: Real-Time Sync Without the Pipeline Tax (opens in a new tab)
8 min
CoCo for Snowflake Apps: From Prompt to Production in Minutes (opens in a new tab)
7 min
Snowflake Just Made Iceberg the Default: What V3, Horizon Catalog, and Managed Storage Mean for Your Lakehouse (opens in a new tab)
10 min
Terraform for Snowflake, But Without Terraform (opens in a new tab)
10 min
Snowflake-Managed vs. Self-Managed Iceberg Tables: What Actually Determines the Difference (opens in a new tab)
7 min
Your Kafka Infrastructure Just Became Optional (opens in a new tab)
9 min
What Actually Happens When You Submit a Spark Job to Dataproc (opens in a new tab)
4 min
Cortex Code is now CoCo, and your Slack channels are about to get a team member who actually knows your data warehouse. (opens in a new tab)
10 min
How to Set Up Snowflake MCP Servers with Per-User OAuth Authentication (opens in a new tab)
7 min
Inside the Snowflake Summit 26 Platform Keynote: Four Acts That Redefine the Agentic Enterprise (opens in a new tab)
11 min
Inside the Snowflake Summit 26 Opening Keynote: What Was Said, What Shipped, and Where Data Is Heading (opens in a new tab)
9 min
The End of Secrets: How Workload Identity Federation is Rewriting Snowflake Authentication (opens in a new tab)
10 min
How a Case-Sensitive Default Role Broke OAuth for 166 Snowflake Users (opens in a new tab)
5 min
The Snowflake OAuth Role That Existed — But Didn’t (opens in a new tab)
7 min
Lineage Tracking with Cortex Code: See Where Your Data Actually Goes (opens in a new tab)
6 min
What is AI Observability and Why It Matters for Enterprises (opens in a new tab)
5 min
Stop Snowflake Cortex AI Bills from Exploding: Build a Credit Monitoring System in SQL (opens in a new tab)
7 min
Snowflake Has 7 Storage Constructs Most Architects Only Know 2 (opens in a new tab)
14 min
Deep Dive into Apache Iceberg Architecture: The Three Layers That Power Your Lakehouse (opens in a new tab)
9 min
Your Cortex Code Agent Should Also Be Your Governance Officer (opens in a new tab)
4 min
The Data Engineer’s Field Guide to Every Snowflake Cortex Service (And What They Actually Cost) (opens in a new tab)
8 min
Querying Partitioned Parquet Files on GCS with DuckDB — A Production-Grade Guide (opens in a new tab)
9 min
Why Apache Iceberg Is Not “Just Another Table Format” (opens in a new tab)
6 min
Understanding Technical Security Controls: The Building Blocks of Snowflake Database Security (opens in a new tab)
6 min
How Moving Snowflake Service Accounts From Passwords to Key-Pair Auth (and NSP Rules) Stopped an Attack — Even When We Weren’t Watching (opens in a new tab)
9 min
2025
The SQL COUNT Trap That Fooled Me at 10 PM (opens in a new tab)
3 min
Snowflake World Tour Amsterdam: Why Your AI Strategy Is Only As Strong As Your Data Foundation (opens in a new tab)
6 min
From Chaos to Clarity: Why Modern Data Teams Choose Atlan (opens in a new tab)
3 min
Data Expo 2025 — Reflections on Data, AI, and the Future of Trusted Innovation (opens in a new tab)
4 min
Fixing vLLM Import Errors in Snowflake Notebooks: A Complete Guide to External Access Integration (opens in a new tab)
4 min
Terraform Targeted Destruction & Error Resolution Cheat Sheet (opens in a new tab)
5 min
Snowflake Intelligence: From Setup to Your First AI-Powered Query (opens in a new tab)
9 min
Building in the Age of AI: Key Insights from Snowflake Summit’s Builder Keynote (opens in a new tab)
6 min
Snowflake Summit Day 2 Recap: 50+ Announcements That Will Transform Your Data Stack (opens in a new tab)
8 min
The Future is Now: Key Takeaways from Snowflake Summit 2025 (opens in a new tab)
5 min
Cut Snowflake Dev Costs with Transient Database Cloning (opens in a new tab)
2 min
Enabling Snowflake Support Case Access for Non-Admin Users: A Complete Guide (opens in a new tab)
3 min
When Airflow UI Goes Dark: Resetting User Credentials via CLI (opens in a new tab)
4 min
Quickly Empty Massive S3 Buckets: The Lifecycle Rule Approach (opens in a new tab)
4 min
Newsletter
Get new posts by email
Subscribe by email (opens in a new tab)
Free. Unsubscribe with one click.