Tj
Tj
How are SRTP constraints going to change after this feature is implemented? According to my understanding, there is now runtime support for static generic method invocation. Will there be an...
Actually I was thinking more in the line of relaxing the inline requirement for SRTP for now runtime supported SRTP. I definitely would want it to be T.property! Its what...
@bartonjs I would take a look at the opentelemetry specs on logging and sampling. Also, python has quite an extensive and modular logging system that supports custom formatters, filters, enrichment...
Both issues linked: https://github.com/dotnet/runtime/issues/100924 https://github.com/dotnet/runtime/issues/103611 Should be replaced with: https://github.com/dotnet/runtime/issues/113068
@tarun111111 This ticket is for documenting migration from the huggingface python world, to the c# world of: * System.Numerics.Tensors * Microsoft.Extenstions.Tokenizers * Onnx / torchsharp / ML.Net The conversion to...
>This looks specific to Bert tokenizer. @tarekgh You are correct that BERT supports this, however it is part of the tokenizer generic API and it is has other implementations of...
@tarekgh Very cool! Is there documentation for this? I would add how to replicate the huggingface behaviours. Also how would truncation work?
@tarekgh I have just tried to use the API you suggested, and I don't see how to use it: ```C# public IReadOnlyList BuildInputsWithSpecialTokens(IEnumerable tokenIds, IEnumerable? additionalTokenIds = null) ``` To...
The workaround works. I think we should create an interface for this so that users can do a capability check on the Tokenizer abstraction. @tarekgh @luisquintanilla WDYT?
I am trying to write a generic library, so I wouldn't know what tokenizer is being used. I guess I can create my own interface and force my users to...