spark-docker-swarm icon indicating copy to clipboard operation
spark-docker-swarm copied to clipboard

running apache spark with docker swarm

Running Spark with Docker Swarm on DigitalOcean

Want to learn how to build this?

Check out the post.

Want to use this project?

  1. Fork/Clone

  2. Sign up for Digital Ocean and generate an access token

  3. Add the token to your environment:

    $ export DIGITAL_OCEAN_ACCESS_TOKEN=[your_token]
    
  4. Spin up three droplets and deploy Docker Swarm:

    $ sh scripts/create.sh
    
  5. Run the script:

    $ sh scripts/run.sh
    
  6. Bring down the resources:

    $ sh scripts/destroy.sh