Daneshwari K.

icon indicating a website link https://medium.com/@daneshwari55555

icon location JNU, New Delhi icon location B. Tech + M. Tech - CSE from SE, JNU, New Delhi. Interested in ML/DL/NLP, Computational Social Sc., data privacy

Results 1 issues of Daneshwari K.

Changing parmater values to extreme in parameters_filtering.py doesn't change the no. f documents being removed

Hi! Kudos to the author for an end-to-end piepline for cleaning and filtering a large corpus. I was working with [main_filtering.py](https://github.com/bigscience-workshop/data-preparation/blob/main/preprocessing/training/01b_oscar_cleaning_and_filtering/main_filtering.py) and was trying to change the parameter values in...