dffml icon indicating copy to clipboard operation
dffml copied to clipboard
verified publisher icon intel

docs: community: Similar projects

Open johnandersen777 opened this issue 4 years ago • 15 comments

Come up with a list of similar projects so people can better orient themselves with where we fit in the landscape

johnandersen777 avatar Dec 15 '21 15:12 johnandersen777

  • https://docs.dagster.io/tutorial
    • Very similar
    • Lacks InputNetwork concept for execution of same flow across multiple machines
    • https://docs.dagster.io/_apidocs/execution
    • Investigate interoperability (they have a bunch of executors and a UI)

johnandersen777 avatar Dec 15 '21 15:12 johnandersen777

https://cloud.google.com/blog/products/ai-machine-learning/serverless-machine-learning-pipelines-on-google-cloud

johnandersen777 avatar Dec 29 '21 17:12 johnandersen777

https://github.com/Auto-DL/Auto-DL

programmer290399 avatar Jan 02 '22 12:01 programmer290399

Issue #363 has many entries as well.

programmer290399 avatar Jan 02 '22 12:01 programmer290399

https://github.com/kedro-org/kedro

johnandersen777 avatar Jan 25 '22 04:01 johnandersen777

https://github.com/great-expectations/great_expectations Not completely but this project has some intersection with our project

programmer290399 avatar Feb 14 '22 03:02 programmer290399

Something that can act as a good inspiration: https://github.com/feast-dev/feast

programmer290399 avatar Feb 14 '22 03:02 programmer290399

MLops:

  1. https://github.com/kubeflow/kubeflow
  2. https://github.com/mlflow/mlflow
  3. https://github.com/pachyderm/pachyderm
  4. https://github.com/Netflix/metaflow
  5. https://github.com/kedro-org/kedro
  6. https://github.com/SeldonIO/seldon-core
  7. https://github.com/flyteorg/flyte
  8. https://github.com/zenml-io/zenml
  9. https://github.com/mlrun/mlrun
  10. https://github.com/ploomber/ploomber

programmer290399 avatar Feb 16 '22 09:02 programmer290399

https://github.com/prefecthq/prefect

programmer290399 avatar Feb 19 '22 13:02 programmer290399

https://www.triggermesh.com/

johnandersen777 avatar Apr 05 '22 05:04 johnandersen777

https://github.com/kestra-io/kestra

johnandersen777 avatar Apr 05 '22 13:04 johnandersen777

https://github.com/linkedin/feathr

johnandersen777 avatar Apr 18 '22 15:04 johnandersen777

https://twitter.com/JustinSaaS/status/1516457804214812673?s=20&t=hz8JZjOODnNpm0J6fadUmw

johnandersen777 avatar Apr 20 '22 15:04 johnandersen777

https://github.com/mattermost/mattermost-server but instead of a service it's a spec

johnandersen777 avatar Apr 22 '22 04:04 johnandersen777

  • Possible integration opportunity: https://github.com/nocodb/nocodb

johnandersen777 avatar Apr 22 '22 04:04 johnandersen777