Karthik Gopalakrishnan

Using ignite with Megatron-style model-parallel PyTorch modules

7

## ❓ Questions/Help/Support This is a somewhat general question, but I'd love a detailed response. When wanting to go beyond standard data-parallel training towards hybrid data+model-parallel training (like Megatron-LM), what...

Host-terminated TLS with Cortex APIs

9

### Description We would like to have host-terminated TLS with our Cortex APIs. At the moment, we are using API Gateway (https://docs.cortex.dev/clusters/networking/https#internal-load-balancer) which is a proxy integration via a private...

Resizing token embeddings to account for new special tokens

1

I've been looking through your project and was wondering, how are you allowing for addition of new special tokens downstream after pre-training? I see some support for HF tokenizers, but...

Runtime error after installation: ImportError: /lib64/libm.so.6: version `GLIBC_2.27' not found

33

I cloned K2 and installed from source on an EC2 instance. Installation went through just fine, but I got the following error at run-time: ``` >>> import k2 Traceback (most...

Kubernetes instructions missing

1

The repo landing page says Kubernetes clusters are supported, but the cluster start guide Kubernetes section says TBD. I would like to reproduce some runs on a Kubernetes cluster. Could...