OneHotArrays.jl
OneHotArrays.jl copied to clipboard
FluxML
Memory efficient one-hot array encodings
The following error showed up in #27: ```julia julia> y1 = onehotbatch([1, 3, 0, 2], 0:9); julia> y1 == y1 true julia> using JLArrays julia> y2 = onehotbatch([1, 3, 0,...
### Motivation and description In Data Science `CategoricalArrays.CategoricalValue` or `CategoricalArrays.CategoricalVector` and the like appear often. (RDatasets loads DataFrames with columns of that type by default). It would be great if...
This pull request introduces a new feature to OneHotArray: the axis in which the vectors are one-hot can be changed at initialization time. This is achieved by a new constructor...
I was hit by the following performance bug, when using this package and MLUtils: ```julia julia> let x, _ = Flux.splitobs(Flux.onehotbatch(rand(1:99, 100), 1:100); at=1.0, shuffle=false) @show summary(x) emb = Flux.Embedding(100...
After working on #36 #35 and getting bogged down with the type inference, I'm trying the other route. I think it might also help with: - Simplifying the underlying code...
### Motivation and description I am working on a layer that produces one hot outputs, so I am looking into using OneHotArrays.jl. My gripe is that currently the datatype only...
Surely this should just work: ```julia julia> ytest 10×10000 OneHotMatrix(::CuArray{UInt32, 1, CUDA.Mem.DeviceBuffer}) with eltype Bool: ⋅ ⋅ ⋅ 1 ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ 1 ⋅ ⋅ 1 ⋅...
Simple Example to Replicate: ``` using Flux using Flux: onehotbatch model = Embedding(26, 5) |> gpu inputs = rand('a':'z', (2, 5)) # NOTE THIS IS 2D SO AFTER CONVERTING TO...
See here: https://github.com/FluxML/Flux.jl/issues/1596
The lack of https://github.com/FluxML/Flux.jl/pull/1959 causes the following error, currently blocking https://github.com/FluxML/Flux.jl/pull/2025 : ```julia julia> using CUDA, OneHotArrays, NNlibCUDA julia> CUDA.allowscalar(false) julia> x = [1, 3, 2]; julia> y = onehotbatch(x,...