metaflow
metaflow copied to clipboard
Netflix
:rocket: Build and manage real-life ML, AI, and data science projects with ease!
If found a few links in the documentation that don't point to an existing page. All links should be updated to existing pages or files. ## Datastore At https://docs.metaflow.org/internals-of-metaflow/technical-overview#datastore, the...
Argo-Workflows UI rejects Metaflow generated Workflows if step name contains "_" Although _sanitize method exists in _dag_templates, a step name with underscore is not sanitized. Example: ``` class HelloArgoFlow(FlowSpec): @step...
Metaflow’s Run class’s [‘finished’ property](https://github.com/Netflix/metaflow/blob/90ee1ede39b7f694007d18a45ebe27333c8e7271/metaflow/client/core.py#L1776) does not become True for failed Runs that do not reach the ‘end’ step. It would be useful if the Run class had a property...
The primary change is implementing `AzureStorage` (analogous to existing `S3Storage`, `LocalStorage`). We are consciously deferring the decision of having first class "data tools" support for Azure. There are some necessary...
https://outerbounds-community.slack.com/archives/C02116BBNTU/p1659523083731559 via chat.metaflow.org
An open-source version of issue #2 -- would love to be able to have Metaflow plugins that support Airflow and Kubernetes! We currently deploy our machine learning models to Kubernetes...
Is there a way to coordinate multiple flows, or for a flow to state that it requires another flow to have run prior? For example if I have a Data...
https://outerboundsco.slack.com/archives/C02116BBNTU/p1658246993734459 through chat.metaflow.org
Hello, Is it possible to use ipdb (or pdb) inside steps? On my code, it hangs without showing anything. I have something like: ```python class MyTrain(FlowSpec): @step def start(self): print("Start...
