

From Messy Data to Usable Data: Data Cleaning & Pipelines
Real-world data is messy: sensors break, values go missing, and formats never match. So how do data professionals turn that chaos into data they can actually use?
Join EnTech for an evening featuring Vijay, an AI Data Engineer, as we go from messy raw data to clean, usable data, with live demos along the way! We'll also kick off our first project: an air quality map of Calgary 🌍 Plus, there's food provided 🍕!
🧹 PART 1: MESSY DATA → USABLE DATA
Why real-world data is messy: different sources, formats, and quality
Common problems like missing values, impossible readings, and duplicates
How to decide what to fix, remove, or flag
A hands-on example cleaning data in Python (pandas)
⚙️ PART 2: DATA PIPELINES + DATA ENGINEERING
What data engineers actually do day to day
How data pipelines move data from raw to ready for analysis
Organizing data in bronze, silver, and gold layers
Automatically catching bad data with quality checks
How tools like Databricks and Airflow are used in industry
💻 Live demo: taking messy air quality data from raw to ready in Databricks!
🕔 SCHEDULE 5:00 PM – Doors open 5:15 PM – Welcome + project intro 5:25 PM – Part 1: Messy data → usable data 5:45 PM – Part 2: Data pipelines + data engineering 6:05 PM – Q&A 6:20 PM – Project kickoff + networking
📅 Monday, November 23 📍 Hunter Hub 🍕 Food provided!
Beginner-friendly. Everyone is welcome! *Topics and speakers may be updated.