I have created spark deployments on Kubernetes (Azure Kubernetes) with bitnami/spark helm chart and I can run spark jobs from master pod. I have also created jupyter hub dep