Real-Time Drilling Data Ingestion
ARC Resources Ltd, Canada · Energy & Utilities
Energy & Utilities
ARC Resources Ltd, Canada
Delivered a streaming analytics platform that ingests rig telemetry from multiple vendor hubs into Databricks, enabling real-time on-bottom drilling performance visibility for field operations.
Key outcomes
- Near real-time drilling insights
- Optimized depth-based storage
Scope of work
Streaming architecture, IoT integration, and operational analytics
Business challenge
High-frequency IoT telemetry arrived from multiple vendors without consistent schema governance. Historical EDR data in legacy systems needed alignment with live feeds to support unified operational reporting.
Our approach
Built a real-time Databricks pipeline using PySpark and Delta Lake with medallion architecture (bronze, silver, gold zones), depth-based on-bottom drilling aggregation, and automated historical EDR backfilling through Azure Data Lake Storage.
Technology stack
Capabilities delivered
Facing a similar challenge?
Let's discuss how Analytics Enablers can help you achieve comparable results.