jgcb00

Make filter on foreign keys works

2

Hi, This very small modification, allows to filter on foreign key

**Is your feature request related to a problem? Please describe.** GPU are most of the time not on the same machine than web crawlers. CPU takes time and is too...

HI, In french we have a ... at the end of sentence but here it doesn't segment right I think it's because etc is also an abreviation that is written...

Support Constraint Generation

1

Hi, It would be great to support constraint generation, following the work of https://github.com/outlines-dev/outlines This should not be to much work, to integrate, but this should probably not be in...

Put the database on HuggingFace

2

Hi, Will it be possible to put the conversations to hugging face so that the open source community can use it to fine-tune open source models. I can help with...

Wrong stats files at the end when the job is relaunch

1

Hi after an error, a fail or anything that may interrupt the executor, the stats calculated at the end of the pipeline doesn't takes in account the stats of already...

Hi, I'm playing a lot with Datatrove and it's very handy to use, we can easily add a lot of Custom Step. Recently I'm trying to create a Decile estimator...

JsonlWriter failed when trying to write Timestamp object

2

Hi, Thanks for this great library I just came across a little bug. When working on the [bigcode/the-stack-v2-train-full-ids](https://huggingface.co/datasets/bigcode/the-stack-v2-train-full-ids) there are some columns with timestamp that are automatically map when read...