neuropod

neuropod copied to clipboard

ci: bump macos-10.15 to macos-12

5

### Summary: Updated the runs-on to macos-12. [GitHub Actions The macOS 10.15 Actions runner image is being deprecated and will be removed by 8/30/22](https://github.blog/changelog/2022-07-20-github-actions-the-macos-10-15-actions-runner-image-is-being-deprecated-and-will-be-removed-by-8-30-22/). ### Test Plan: n/a

liby

Support for newer versions of Torchscript

14

Hey @VivekPanyam, we're still big Neuropod users at Ludwig. We are interested in using the Torchscript backend, but seems 1.5.0 is still the most recent version with published wheels: https://download.neuropod.ai/whl/stable.html...

tgaddair

Neuropod's release cadence has been a bit odd in that we've released a bunch of RCs since the initial public release, but haven't put out a new "stable" release (although...

VivekPanyam

## Context The user provided `node_name_mapping` is not used when running TF SavedModels. It's only used when running TF frozen graphs. TF SavedModels have `SignaureDef`s. These are quite similar to...

VivekPanyam

### Summary: Neuropod did not initially use C++14 so we needed our own `make_unique` implementation. We upgraded past C++14 a while ago so this is no longer necessary. ### Test...

VivekPanyam

Loose the Neuropod backend version match

2

## Feature ## Is your feature request related to a problem? Please describe. In Michelangelo, Neuropod JNI and backends are built into different places: Neuropod JNI is built into a...

jiaguofang

Self-contained JAR with OS-Arch specific native libraries

5

### Summary: Improve current fat jar to make it completely self-contained JAR with OS-Arch specific native libraries. New "fat" JAR has embedded resources with JNI library, Neuropod Core and Backend...

vkuzmin-uber

[Python] Add initial support for asyncio

1

### Summary: Add initial support for running infer using `asyncio`. This implementation currently blocks the event loop so it shouldn't be used just yet ### Test Plan: Added a test...

VivekPanyam

[Build] Refactor OPE code to adhere to stricter build warnings

1

### Summary: Refactor code under `source/neuropod/multiprocess` to adhere to the stricter set of warnings introduced in #437 ### Test Plan: CI

VivekPanyam

[Experimental] Add a RuntimeOption to set inter and intra op threadpool sizes

1

### Summary: Allow users to configure intra-op and inter-op thread pool sizes for the underlying frameworks. **Note: This API is experimental and may change in the future.** ### Test Plan:

VivekPanyam