Stop Parsing Data Manually: How AI Extracts Structure from Unstructured Data
How LLMs extract structure from unstructured data on Databricks: sampling, schema-enforced outputs, validation, quarantine tables and human review.
Andrzej Gabryel
Author
Andrzej Gabryel
- 10
Articles
First article
Latest article
Areas of expertise
- Data Engineering
- AI Engineering
Articles by Andrzej Gabryel
Turning GitHub Copilot Into an Engineering Workflow
Custom agents, instruction files, skills and mandatory gates turn GitHub Copilot from an ad-hoc assistant into an engineering workflow you can audit.
Andrzej Gabryel
Why Specialized AI Agents Beat One General Coding Assistant
Specialized AI agents keep implementation, testing, debugging and research in separate, reviewable lanes instead of one long coding assistant chat.
Andrzej Gabryel
AI as Your Junior Data Engineer: Delegating the Right Tasks
Learn to use AI as a junior data engineer to offload repetitive work, speed up pipelines, and focus your time on the decisions that actually matter.
Andrzej Gabryel
You Don't Write SQL Anymore - Now What?
AI now writes much of our SQL. What that changes about knowing data, as the hard part moves from writing queries to modeling, translation and doubt.
Andrzej Gabryel
Stop Profiling Data Manually: How AI Can Improve Data Quality in Databricks
Manual data profiling slows the move from Bronze to Silver. Use AI-assisted rules and automated checks in Databricks to raise data quality faster.
Andrzej Gabryel
AI‑Assisted Data Engineering: How to Use GenAI for Pipeline Incident Triage (Without Creating Chaos)
Using GenAI for pipeline incident triage: an operating model for faster debugging, better runbooks and lower MTTR, without new security or on-call risks.
Andrzej Gabryel
Batch vs Streaming vs Micro‑Batch in CPG and Retail: Stop Overpaying for ‘Real‑Time’ That Doesn’t Deliver ROI
Real-time data is a trade-off, not a goal. How to choose batch, streaming or micro-batch in CPG and retail, with POS, OSA and promo compliance examples.
Andrzej Gabryel
Beyond the Hype: Why Data Engineering Needs Proof-of-Value (PoV) Instead of Proof-of-Concept (PoC)
Most AI projects stall before production. Why data engineering teams should run a business-first Proof-of-Value instead of a Proof-of-Concept to show ROI.
Andrzej Gabryel
Smarter, Faster, Stronger: The AI-Powered Operating Model for Data Engineering
An AI-powered operating model for data engineering turns noisy pipeline failures into fast, auditable recoveries, with earlier detection and safe fixes.
Andrzej Gabryel