Hi Kidane Weldemariam, can you share me your “spark-submit” command? The issue looks same with one I’ve faced before. Can you confirm these following from your side:

• --master k8s://https://<k8s-apiserver-host>:<k8s-apiserver-port>: even https:// was defined, spark-submit requires :port, e.g: :443
• Kubernetes client has been upgraded to 4.4.2 as mentioned here https://gist.github.com/tunguyen9889/32a7a88b0dfeb88afe5e936535f1c97c#file-spark_docker_build-sh-L27-L28

Let me know if you’re able to fix it.