Loading a trillion rows of weather data into TimescaleDB with Ali Ramadhan

​Join us for an engaging and informative webinar featuring Ali Ramadhan, the writer behind the insightful blog post, "Building a weather data warehouse part I: Loading a trillion rows of weather data into TimescaleDB".

Ali benchmarks the insert and copy statements from Python using pandas, psycopg3, and SQLAlchemy then moves onto benchmarking utilities such as pg_bulkload and timescaledb-parallel-copy. Also considered are parallel data loading, sustained insert rates, and tweaking Postgres configurations. The talk ends with some conclusions on how to insert data into TimescaleDB most efficiently.

​The webinar will kick off with a detailed 30-minute presentation followed by an open Q&A session where attendees can ask Ali and the Timescale team questions.

​What to Expect:

​Presentation (30 mins)
Ali will kick off the webinar with a detailed presentation on his recent benchmarks of inserting a trillion rows into Postgres and TimescaleDB. He will cover:

• ​The motivation behind this massive benchmark.

• ​The setup and tools used, focusing on TimescaleDB.

• ​How to set it? Is it easy? 

• ​Key findings and their implications for handling large-scale time-series data

​Q&A Session (30 mins)

• ​Address/Review HackerNews + Reddit comments

• ​Questions from participants

​The webinar will conclude with an open Q&A session, where attendees can ask Ali specific questions about his findings, challenges faced, and his recommendations for data management at scale.

​Featured Speaker:

​Ali Ramadhan is an applied scientist with interests at the intersection of weather forecasting and climate prediction, data engineering, and machine learning.