Back to Browse

Deploying and Using Dask Clusters on Kubernetes (with Python)

1.4K views
Nov 28, 2023
17:01

Welcome to our tutorial on setting up and using Dask on Google Kubernetes Engine! Topics Include: * Use of Helm, the Dask operator, and Custom Resource Definitions (CRDs) * Creation of a Kubernetes cluster * Use of Google Cloud Shell and CLI tools * Installation of the Dask Operator and Dask Cluster CRDs * Review of Python and Dask parallel computing example code * Configuration of Dask Clusters * Debugging and error handling Free Trial - Our New Diagram Tool: https://softwaresim.com/pricing/ ("YOUTUBE24" for 25% Off) If you are a cloud, DevOps, or software engineer you’ll probably find our wide range of YouTube tutorials, demonstrations, and walkthroughs useful - please consider subscribing to support the channel. 0:00 Conceptual Overview 1:37 Kubernetes Cluster 3:34 Helm Installation of Dask Operator 4:42 Kubectl Installation of Dask CRD 7:39 First Pass with the Dask Cluster 12:40 Second Pass with the Dask Cluster

Download

1 formats

Video Formats

360pmp425.3 MB

Right-click 'Download' and select 'Save Link As' if the file opens in a new tab.

Deploying and Using Dask Clusters on Kubernetes (with Python) | NatokHD