Cover Image for From Messy Data to Usable Data: Data Cleaning & Pipelines
Cover Image for From Messy Data to Usable Data: Data Cleaning & Pipelines
26 Going

From Messy Data to Usable Data: Data Cleaning & Pipelines

Hosted by EnTech Calgary, Hewan & Savitur Maharaj
Registration
Approval Required
Your registration is subject to host approval.
Welcome! To join the event, please register below.
About Event

​Real-world data is messy: sensors break, values go missing, and formats never match. So how do data professionals turn that chaos into data they can actually use?

​Join EnTech for an evening featuring Vijay, an AI Data Engineer, as we go from messy raw data to clean, usable data, with live demos along the way! We'll also kick off our first project: an air quality map of Calgary 🌍 Plus, there's food provided 🍕!

​🧹 PART 1: MESSY DATA → USABLE DATA

  • ​Why real-world data is messy: different sources, formats, and quality

  • ​Common problems like missing values, impossible readings, and duplicates

  • ​How to decide what to fix, remove, or flag

  • ​A hands-on example cleaning data in Python (pandas)

​⚙️ PART 2: DATA PIPELINES + DATA ENGINEERING

  • ​What data engineers actually do day to day

  • ​How data pipelines move data from raw to ready for analysis

  • ​Organizing data in bronze, silver, and gold layers

  • ​Automatically catching bad data with quality checks

  • ​How tools like Databricks and Airflow are used in industry

  • ​💻 Live demo: taking messy air quality data from raw to ready in Databricks!

​🕔 SCHEDULE 5:00 PM – Doors open 5:15 PM – Welcome + project intro 5:25 PM – Part 1: Messy data → usable data 5:45 PM – Part 2: Data pipelines + data engineering 6:05 PM – Q&A 6:20 PM – Project kickoff + networking

​📅 Monday, November 23 📍 Hunter Hub 🍕 Food provided!

​Beginner-friendly. Everyone is welcome! *Topics and speakers may be updated.

Location
Hunter Hub for Entrepreneurial Thinking
460 Campus Ln NW, Calgary, AB T2N 1N4, Canada
26 Going