System Design Level 1: Foundational Workshop: Live Solve Session
🛠️ System Design Workshop Series: From Foundations to Expert-Level Systems
Overview: The #SoulBits System Design Journey
Join us for a four-part, hands-on, collaborative system design workshop series. We'll move step-by-step from fundamental scaling concepts to designing complex, real-time, expert-level systems. Each 1-hour session is limited to a small, curated group (max 7 participants) to ensure deep engagement and real-time problem-solving. This is an application-based series.
Session 1: Level 1 — Foundational Scaling & Utility
Theme: Establishing the Basics: Hashing, IDs, and Utility Services.
Focus: Core database choices, basic data partitioning, unique ID generation, and rate limiting algorithms.
Target Audience: Individuals new to system design or those needing to solidify foundational building blocks.
Case Studies (Solve 1 or 2):
URL Shortener (TinyURL): Focus on collision resolution, base62 encoding, and simple database design.
API Rate Limiter: Deep dive into algorithms like Token Bucket or Leaky Bucket and distributed counter management.
Optional: Unique ID Generator (e.g., Snowflake).
Key Takeaways: Understanding how to calculate required storage/QPS, implement basic scaling techniques, and choose appropriate algorithms for foundational system components.
Session 2: Level 2 — Data Partitioning & Distributed Storage
Theme: Scaling Data Layer: Caching, Key-Value Stores, and Indexing.
Focus: Introducing distributed storage concepts, trade-offs between consistency and availability, efficient indexing, and managing large binary objects.
Target Audience: Those familiar with basic scaling who want to tackle core distributed data challenges.
Case Studies (Solve 1 or 2):
Consistent Hashing (Deep Dive): Understanding its mechanics and how it improves caching/sharding elasticity.
Image Hosting Service (Instagram): Focus on storing large binary data, efficient thumbnail generation, and global CDN strategy.
Key-Value Store (Simplified DynamoDB): Design the core structure, focusing on data replication and eventual consistency.
Key Takeaways: Mastering Consistent Hashing, understanding the CAP Theorem in practice, and designing for multimedia content delivery at scale.
Session 3: Level 3 — Complex Indexing & Fan-Out Systems
Theme: The Twitter/Facebook Challenge: Search, Feeds, and Large-Scale Data Flow.
Focus: Designing systems that require massive-scale indexing, real-time index updates, and managing the "fan-out" problem (delivering content to millions instantly).
Target Audience: Participants aiming for Senior/Staff Engineer roles, focusing on optimizing data flow and retrieval speed.
Case Studies (Solve 1 or 2):
Twitter Newsfeed / Facebook News Feed: Detailed discussion on Fan-out-on-Write vs. Fan-out-on-Read strategies and feed ranking.
Twitter Search: Designing the architecture for near-real-time search using an inverted index that updates constantly.
Cloud Storage (Dropbox/Google Drive): Focus on file synchronization across devices, conflict resolution, and block storage.
Key Takeaways: Deep understanding of indexing structures, push vs. pull models for content delivery, and ensuring data consistency in distributed file systems.
Session 4: Level 4 — Expert Real-Time & Geospatial Systems
Theme: The Real-Time Frontier: Chat, Streaming, and Geospatial Matching.
Focus: Designing the most challenging systems, requiring low-latency communication, complex state management, and specialized geospatial indexing.
Target Audience: Aspiring Principal/Staff Engineers ready to integrate multiple complex subsystems.
Case Studies (Solve 1):
Ride-Sharing Service (Uber/Lyft): The ultimate challenge, combining geospatial indexing (e.g., GeoHash) for driver matching with real-time updates and complex state management.
Real-Time Chat System (WhatsApp/Messenger): Strong focus on WebSockets, message ordering, and handling user presence across millions of connections.
Alternative: Video Streaming (YouTube/Netflix): Designing adaptive bitrate streaming and global infrastructure for low-latency video delivery.
Key Takeaways: Mastery of real-time protocols (WebSockets), utilization of geospatial data structures, and designing highly available and reliable mission-critical systems.
Application & Next Steps (Important Luma Block)
APPLY TO ATTEND: This is an application-based series with a maximum of 7 participants per session to ensure a high-quality, interactive experience.
Register your interest for the full series or individual sessions below.
You will be asked to select your preferred session and explain your motivation.
Approval Notification: If approved, you will receive a personal meeting invite from #SoulBits with the session details and pre-read materials by [Date - e.g., Nov 28th].