Git for Delta: Bringing Git-like Version Control and Transactional Guarantees to Your Data Lake
Modern data teams face the challenge of managing ever-growing data lakes while ensuring data quality, reproducibility, and operational agility. This webinar explores how combining lakeFS and Delta Lake empowers organizations to apply software engineering best practices-such as version control, branching, and CI/CD-to their data, unlocking new levels of reliability and collaboration.
When used together, lakeFS and Delta Lake enable:
🔹 Concurrent Writes: Delta Lake’s optimistic concurrency control keeps data consistent, while lakeFS adds isolation and safe merging of changes, so your team can collaborate without risk of data corruption or conflicts.
🔹 Isolated Experimentation: Instantly branch your entire data lake-including Delta tables-for safe, parallel development and testing, without copying data.
🔹 Automated Data Quality and CI/CD: Integrate hooks to validate Delta table contents, schema, and referential integrity before merging changes, promoting only high-quality data to production.
🔹 Effortless Rollback and Reproducibility: Restore or reproduce any data state with commit history, supporting robust troubleshooting and ML experiment reproducibility.
Join this session to see practical demonstrations of lakeFS and Delta Lake integration in action, learn best practices for managing data as code, and discover how these technologies can transform your data lake into a collaborative, reliable, and production-ready platform for analytics and machine learning! Speakers: Ion Koutsouris, Rustacean & Delta Maintainer Robert Pack, Staff Developer Advocate, Databricks