In pyspark 1.6.2, I can import col function by
col
from pyspark.sql.functions import col
but when I try to look it up in the Githu
In Pycharm the col function and others are flagged as "not found"
a workaround is to import functions and call the col function from there.
functions
for example:
from pyspark.sql import functions as F df.select(F.col("my_column"))