Detecting face masks using Azure Cognitive ServicesAzure Cognitive Services provide us with APIs to a number of pre-trained models across Speech, Language, Vision and Decisions. One of the Vision APIs…
Introduction to PySpark Part 5 - Aggregating DataThis is the fifth part in a series of blog posts as an introduction to PySpark. The other parts of this blog post…
Introduction to PySpark Part 4 - Summarising DataThis is the fourth part in a series of blog posts as an introduction to PySpark. The other parts of this blog post…
Introduction to PySpark Part 3 - Adding, Updating and Removing ColumnsThis is the third part in a series of blog posts as an introduction to PySpark. The other parts of…
Introduction to PySpark Part 2 - Selecting, Filtering and Sorting DataThis is the second part in a series of blog posts as an introduction to PySpark. The other parts of…
Introduction to PySpark Part 1 - Creating DataFrames and Reading Data from FilesThis is the first part in a series I'm putting together as an introduction to PySpark. I find…
Automated Deployment of Serverless Python Web APIs using Azure Functions and Azure DevOpsIn this post we're going to go through the end-to-end automated deployment of a web API created in…
Unit Testing with DatabricksPart 2 - Integrating PySpark Unit Testing into an Azure Pipelines CI PipelineThis is part 2 of 2 blog posts exploring PySpark unit testing with Databricks. In…
Unit Testing with DatabricksPart 1 - PySpark Unit Testing using Databricks ConnectOn my most recent project, I've been working with Databricks for the first time. At first I found using…
Using PySpark to Read and Flatten JSON data with an enforced schema In this post we're going to read a directory of JSON files and enforce a schema on load…