Spark and database credentials and paths should be user configurable
There are a few instances of hardcoded network paths and credentials in the app.
For example:
app/utils/spark_utils.py
5: .master('spark://127.0.0.1:7077')\
app/__init__.py
4:#from flask_mongoengine import MongoEngine
9:__mongo_host = "localhost"
10:__mongo_port = 27018
These should default to localhost
and whatever is the default port; but also be user configurable via environment variables, such as HARMONIZATION_MONGO_HOST
and optionally via config file.