Skip to content

Commit 745b8b6

Browse files
committed
Downgraded to java 1.8.
Removed the plugin module. Added one more example. Updated README
1 parent ed8ed07 commit 745b8b6

File tree

1 file changed

+9
-1
lines changed

1 file changed

+9
-1
lines changed

README.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,9 @@ A Spark bootstrap project written in Scala with gradle as build tool.
3838
#### Spark Submit commands in shell
3939

4040
> A local spark instance must be up and running: http://localhost:8080/
41+
> spark history server http://localhost:18080/
42+
43+
#### Run the Main class reads people-example.csv and get the average age
4144

4245
spark-3.4.1-bin-hadoop3/bin/spark-submit \
4346
--verbose --class dev.template.spark.Main \
@@ -46,12 +49,17 @@ A Spark bootstrap project written in Scala with gradle as build tool.
4649
--driver-memory 1g \
4750
--executor-memory 1g \
4851
--executor-cores 2 \
49-
build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar
52+
build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar \
53+
src/main/resources/people-example.csv \
54+
55+
##### Run a simple app RddCollect with spark session in local
5056

5157
spark-3.4.1-bin-hadoop3/bin/spark-submit --class dev.template.spark.RddCollect \
5258
--master spark://localhost:7077 \
5359
build/libs/spark-scala-gradle-bootstrap-2.12.0-all.jar
5460

61+
##### Run CovidDataPartitioner app reads covid deaths in US counties and partitioned by reported date
62+
5563
spark-3.4.1-bin-hadoop3/bin/spark-submit --class dev.template.spark.CovidDataPartitioner \
5664
--packages io.delta:delta-core_2.12:2.4.0 \
5765
--master spark://localhost:7077 \

0 commit comments

Comments
 (0)