yobi byte

icon indicating a website link yobibyte.github.io

icon location Oxford icon location Senior Research Scientist @ NVIDIA. ex: Machine Learning/ RL PhD student at the University of Oxford, Intern at DeepMind, MSR, Facebook, NVIDIA; Latent Logic.

Results 7 issues of yobi byte

modify sorting example to have arrays of different lengths

Use named tuples instead of tuples to store graph entities

good first issue

Take multidimensional features of the entities into account.

Right now, I assume that features of the entities span along one dimension only. Pictures are not allowed. As soon as we would like to something with pics, it will...

Make output nicer and add colors

https://github.com/Textualize/rich

enhancement
good first issue

Replace current model interface with llama-cpp bindings

https://github.com/abetlen/llama-cpp-python

enhancement

Implement PDF -> text parsing

To understand better how this works, I'll do it myself instead of getting existing solutions with lots of dependencies. I'll simply use pypdf for this to start with.

enhancement

Fix softmax dependenc on padded vocab size.

2 comment

# What does this PR do ? Currently, both in megatron-inference and megatron-rl code, we calculate softmax on full logits, i.e. including those that correspond to padded vocabulary. This should...