One of our most often requested videos is how you work with custom Python wheels within Azure Synapse Spark Pools! Managing your code via wheels gives you a whole load of control and reusability of your functions - its a fantastic way to keep track of who's using which version too!
In this video, Simon runs through the process of encapsulating some code as a reusable function, building it into a wheel file and uploading that wheel to a Synapse Spark pool!
More information about managing spark pools & their associated libraries can be found here: https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-portal-add-libraries
If the idea of a pre-built Spark Data processing framework such as Hydr8 appeals, get in touch with Advancing Analytics via our website! https://www.advancinganalytics.co.uk/
