Command-line options for spark-submit
--executor-memory 1g
(default 512MB): Each executor has 1GB of RAM.--master local[8]
: run locally on 8 cores. Alternatives includespark://111.222.11.22 :7077
for a Spark standalone cluster, oryarn
to run on YARN (Hadoop)--class
: The “main” class to run if you submit a Scala or Java program