System Design Level 3 Live Solve Session: Complex Indexing & Fan-Out Systems
🛠️ System Design Workshop Series: From Foundations to Expert-Level Systems
Overview: The #SoulBits System Design Journey
Join us for a four-part, hands-on, collaborative system design workshop series. We'll move step-by-step from fundamental scaling concepts to designing complex, real-time, expert-level systems. Each 1-hour session is limited to a small, curated group to ensure deep engagement and real-time problem-solving. This is an application-based series.
Session 1: Level 1 — Foundational Scaling & Utility
Session 2: Level 2 — Data Partitioning & Distributed Storage
Session 3: Level 3 — Complex Indexing & Fan-Out Systems
Theme: The Twitter/Facebook Challenge: Search, Feeds, and Large-Scale Data Flow.
Focus: Designing systems that require massive-scale indexing, real-time index updates, and managing the "fan-out" problem (delivering content to millions instantly).
Target Audience: Participants aiming for Senior/Staff Engineer roles, focusing on optimizing data flow and retrieval speed.
Case Studies (Solve 1 or 2):
Twitter Newsfeed / Facebook News Feed: Detailed discussion on Fan-out-on-Write vs. Fan-out-on-Read strategies and feed ranking.
Twitter Search: Designing the architecture for near-real-time search using an inverted index that updates constantly.
Cloud Storage (Dropbox/Google Drive): Focus on file synchronization across devices, conflict resolution, and block storage.
Key Takeaways: Deep understanding of indexing structures, push vs. pull models for content delivery, and ensuring data consistency in distributed file systems.
Session 4: Level 4 — Expert Real-Time & Geospatial Systems
Theme: The Real-Time Frontier: Chat, Streaming, and Geospatial Matching.
Focus: Designing the most challenging systems, requiring low-latency communication, complex state management, and specialized geospatial indexing.
Target Audience: Aspiring Principal/Staff Engineers ready to integrate multiple complex subsystems.
Case Studies (Solve 1):
Ride-Sharing Service (Uber/Lyft): The ultimate challenge, combining geospatial indexing (e.g., GeoHash) for driver matching with real-time updates and complex state management.
Real-Time Chat System (WhatsApp/Messenger): Strong focus on WebSockets, message ordering, and handling user presence across millions of connections.
Alternative: Video Streaming (YouTube/Netflix): Designing adaptive bitrate streaming and global infrastructure for low-latency video delivery.
Key Takeaways: Mastery of real-time protocols (WebSockets), utilization of geospatial data structures, and designing highly available and reliable mission-critical systems.
Application & Next Steps (Important Luma Block)
APPLY TO ATTEND: This is an application-based series to ensure a high-quality, interactive experience.
Register your interest for the full series or individual sessions below.
You will be asked to select your preferred session and explain your motivation.
Approval Notification: If approved, you will receive a personal meeting invite from #SoulBits with the session details and pre-read materials by [Date - e.g., Nov 28th].