PySpark java.io.IOException: No FileSystem for scheme: https

Question

I am using local windows and trying to load the XML file with the following code on python, and i am having this error, do anyone knows how to resolve it,

Answer 1

The error message says it all: you cannot use dataframe reader & load to access files on the web (http or htpps). I suggest you first download the file locally.

See the pyspark.sql.DataFrameReader docs for more on the available sources (in general, local file system, HDFS, and databases via JDBC).

Irrelevantly to the error, notice that you seem to use the format part of the command incorrectly: assuming that you use the XML Data Source for Apache Spark package, the correct usage should be format('com.databricks.spark.xml') (see the example).