George Richardson
George Richardson
@zachmueller I remember somewhere seeing that you had something on this?
Just to lend some inspiration from the internal-displacement project, it could also be interesting and useful to use some NLP to also extract text that isn't a hyperlink, but does...
@WanderingStar This looks good to me. By "read scrape requests from the database" do you mean that new additions to the database could automatically trigger scraping?
We could also look at links in the text to see what other sources they cite. Are you envisioning that this kind of score be hard coded or that there...
Sorted out notebooks. Code still needs cleaning.
Thanks @Cl34r. Checking that out.
Latest approach in `classification` notebook
The ML I'm thinking of for this particular issue are to tag the articles as about displacement/not about displacement and then as disaster/conflict/other as the reason for displacement
Hey @tdraebing. Sorry for the slow reply. Sounds good to write generic functions. How did you envision scoring each individual entry/column?
That's a good question...