README.md 693 B

spark-config-generator.py

This script generates a random SPARK configuration based on 107 SPARK parameters using the opentuner library.

When running the script, you might get the following error:

TypeError: Unicode-objects must be encoded before hashing

To fix this, first locate the installation path of opentuner package:

python3 -c "import opentuner; print(opentuner.__file__)"

Then edit the following line in file search/manipulator.py

@@ 858c858 @@
- return hashlib.sha256(repr(self.get_value(config)).encode('utf-8')).hexdigest().encode('utf-8') 
+ return hashlib.sha256(repr(self.get_value(config)).encode('utf-8')).hexdigest().encode('utf-8')