Matthew Steffen

Update rabbitmq image for pach 2.1.0-rc.1

1

We couldn't get the docker image built for the 2022-02-15 testing war room, and the old image had an old, incompatible version of pachd in it, so I a) updated...

Remove port_forwarders from pach config if port-forward process is dead

1

This PR fixes a corner-case with `pachctl port-forward`. Basically, if the `port-forward` process is killed by anything other than `sigint`, it never gets the opportunity to remove the `port_forwarders` section...

Integration Ideas

1

This issue should be rewritten as an RFC, but just recording some of our ideas from this morning: - When integrating with other systems, Pachyderm should ideally be the triggering...

Not intended to be merged, just here to show the changes I made for betterproto

Change proto package author from `[email protected]` to `[email protected]`

1

When @albscui created the initial python-pachyderm proto package, he set himself as the package author for expediency. However, to make sure that future contributors to the package have access to...

See https://github.com/pachyderm/pachyderm/issues/6116 Once support for generating a python module from Pachyderm's protobufs has been added to the main Pachyderm repo, we should migrate python-pachyderm to use that module instead of...

Walk through the "pachyderm user" onboarding track, and make it work with python-pachyderm

1

General feedback from users has been that python-pachyderm is hard to use. For example, we've heard "there's no way to parse a Pachyderm file as a CSV or a pandas...

Currently `pachctl` support `.pachignore` files under the path in `transform.build.path`, but `python-pachyderm` doesn't. Ideally the two should be brought to parity

Also, set the AWS creds env vars to the same value in s3-enabled pipelines Jira: [CORE-1014] [CORE-1014]: https://pachyderm.atlassian.net/browse/CORE-1014?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ

See #9615