Efficient communication is paramount to data science, at the same time being very challenging, given it’s dominated by high-level languages such as Python. We will show how UCX-Py leverages UCX performance greatly for distributed frameworks such as Dask and GPU-accelerated ecosystem RAPIDS. The performance achieved is seen in the COVID-19 research on Summit, the world’s largest supercomputer at ORNL.
Presented by Ben Zaitlen, NVIDIA, Peter Entschev, NVIDIA, and Matthew Baker, ORN.
Learn more about the UCF Consortium at www.ucfconsortium.org.
