spark-docker-swarm
spark-docker-swarm copied to clipboard
running apache spark with docker swarm
Running Spark with Docker Swarm on DigitalOcean
Want to learn how to build this?
Check out the post.
Want to use this project?
-
Fork/Clone
-
Add the token to your environment:
$ export DIGITAL_OCEAN_ACCESS_TOKEN=[your_token] -
Spin up three droplets and deploy Docker Swarm:
$ sh scripts/create.sh -
Run the script:
$ sh scripts/run.sh -
Bring down the resources:
$ sh scripts/destroy.sh