To launch from CLI: spark-submit mySparkCode.py argv1 argv2 argv3
spark-submit mySparkCode.py argv1 argv2 argv3
While in the '.py' file you must also create the spark context:
from pyspark import SparkContext, SparkConf conf = SparkConf() sc = SparkContext(conf=conf)
To read an input from CLI:
import sys argList = argv[1:]
There was an error while loading. Please reload this page.