[Ray Meetup] Ray Compiled Graphs Deep Dive

​Join us for our next Ray Meetup, where we'll dive into the world of accelerated execution on GPUs for training and inference.

​Hosted by the Ray team, the meetup will take place on October 29, 2024, from 5:30 PM to 7:30 PM at Anyscale's vibrant San Francisco office. This session is perfect for developers, data scientists, and AI enthusiasts eager to explore how Ray Core can supercharge your machine learning workflows. Compiled Graphs is a new feature in Ray that offers a classic Ray Core-like API with three major advantages:

1. ​Reduced system overhead for repetitive task graphs

2. ​Native support for GPU-GPU communication via NVIDIA NCCL

3. ​Optimized scheduling to avoid deadlock and best utilize compute and communication resources

​In comparison to the standard Ray API, Compiled Graphs are expressed as a static computation graph.The Compiled Graphs API is designed to support a variety of use cases including faster model-parallel inference and state of the art distributed training.  Benchmarking has shown up to a 20% increase in training throughput and 43% improvement in token-per-dollar efficiency compared to other frameworks.Don't miss out on the opportunity to connect with like-minded individuals and expand your expertise in the ever-evolving field of AI. We look forward to seeing you there!

​Virtual attendance for those who cannot join in person:
https://anyscale.zoom.us/j/87128606621?pwd=vV8Lj2qADavTyNaFy23KbQH41McLbO.1