File tree Expand file tree Collapse file tree 1 file changed +9
-1
lines changed Expand file tree Collapse file tree 1 file changed +9
-1
lines changed Original file line number Diff line number Diff line change @@ -38,6 +38,9 @@ A Spark bootstrap project written in Scala with gradle as build tool.
3838#### Spark Submit commands in shell
3939
4040> A local spark instance must be up and running: http://localhost:8080/
41+ > spark history server http://localhost:18080/
42+
43+ #### Run the Main class reads people-example.csv and get the average age
4144
4245 spark-3.4.1-bin-hadoop3/bin/spark-submit \
4346 --verbose --class dev.template.spark.Main \
@@ -46,12 +49,17 @@ A Spark bootstrap project written in Scala with gradle as build tool.
4649 --driver-memory 1g \
4750 --executor-memory 1g \
4851 --executor-cores 2 \
49- build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar
52+ build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar \
53+ src/main/resources/people-example.csv \
54+
55+ ##### Run a simple app RddCollect with spark session in local
5056
5157 spark-3.4.1-bin-hadoop3/bin/spark-submit --class dev.template.spark.RddCollect \
5258 --master spark://localhost:7077 \
5359 build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar
5460
61+ ##### Run CovidDataPartitioner app reads covid deaths in US counties and partitioned by reported date
62+
5563 spark-3.4.1-bin-hadoop3/bin/spark-submit --class dev.template.spark.CovidDataPartitioner \
5664 --packages io.delta:delta-core_2.12:2.4.0 \
5765 --master spark://localhost:7077 \
You can’t perform that action at this time.
0 commit comments