StringEncodings.jl

StringEncodings.jl copied to clipboard

I have to convert text files from an UTF-encoding to a ISO-8859-1-encoding. In this case not all characters can be converted to the target encoding. So, whenever `encode` encounters a...

roland-KA

Hello, I want to search in some text for a keyword and extract the Text beginning with the keyword to the end. I have the following simplified example: ```[julia] (path,...

judober

Add `Base.unsafe_read()` and `Base.unsafe_write()`. Closes #39

alyst

Add optimized read! and and write methods

1

https://github.com/JuliaStrings/StringEncodings.jl/pull/38 implements an optimized `readbytes!` method. The same approach could be used to make `read!` and `write` more efficient with arrays, probably by overloading `Base.unsafe_read` and `Base.unsafe_write`.

nalimilan

Inaccurate comment of flush

1

The comment says that `flush` returns the number of bytes written to output buffer, but it returns the encoder. Is the comment outdated? https://github.com/JuliaStrings/StringEncodings.jl/blob/5ad92b78bfcee0bf488eee85dcac59ab24cbe76b/src/StringEncodings.jl#L219-L234

metab0t

Make decode() interface accept AbstractVector

1

Hi, we are working a lot with @view/SubArray on top of a larger buffer. Currently the decode() function requires a Vector{UInt8} argument. For us it means we need to copy...

jdonnerstag

At #40 a crash wasn't caught by tests, probably because none of them covers strings longer than the buffer. It's essential to also test that. It's possible that BUFSIZE was...

nalimilan

Test

1

nalimilan

Introduce Encoding parametric singleton type

14

First step towards efficient encoders for common encodings, as well as towards providing information about encodings. This also allows adding convenience methods to base I/O functions taking an additional encoding...

nalimilan

```julia julia> readuntil(IOBuffer("noël"), enc"UTF-8", "ë") "no" julia> readuntil(IOBuffer("noël"), enc"UTF-8", 'ë') ERROR: MethodError: no method matching position(::StringDecoder{Encoding{Symbol("UTF-8")},Encoding{Symbol("UTF-8")},Base.GenericIOBuffer{Array{UInt8,1}}}) Closest candidates are: position(::Base.Filesystem.File) at filesystem.jl:225 position(::Base.Libc.FILE) at libc.jl:92 position(::IOStream) at iostream.jl:188 ... Stacktrace:...

nalimilan