Home Explore Help
Sign In
demo.masouros
/
SparkLE
Watch 1
Star 0
Fork 0
Files Issues 0 Pull Requests 0 Wiki

No Description

Branch: master
Branches Tags
SparkLE
ZIP TAR.GZ
demo.masouros eed77eaaf8 changed README 4 years ago
docker f7de103c31 Changed README 4 years ago
kube 8c301bcb1f Kubernetes related stuff 4 years ago
src eed77eaaf8 changed README 4 years ago
README.md 7b886842fa Changed README 4 years ago

README.md

SPARK Autotuning

Structure

  • docker: Contains the container used to run Spark applications on the cluster. Currently Spark v3.0 is used with Hadoop v2.7 and Scala v2.12
  • kube: Contains the necessary YAML files to deploy Sparkbench on a kubernetes cluster. Modification might be needed to suit your cluster.
  • src:

1. Generating the Spark configurations

Please see src/python/README.md for instructions.