data-science icon indicating copy to clipboard operation
data-science copied to clipboard

Create Web Scraping Tutorial

Open ryanmswan opened this issue 4 years ago • 34 comments

Overview

Update the Web Scraping with resources and an article header.

Action Items

  • [x] Create a Google Doc in the folder provided under resources
    • [x] Draft an introductory paragraph explaining what the tutorial resources cover and why a new data scientist would use them for working with data at Hack For LA
    • [x] Identify resources with vetted tutorials covering important skills within the tutorial area, adding to the draft
  • [x] Review the draft with the Data Science CoP
  • [x] Add to the wiki page

Resources/Instructions

Wiki page

Web Scraping Tutorial

Location for any files you might need to upload (drafts, images, etc.)

Tools that are core that should be mentioned:

  • Python
  • Selenium
  • BeautifulSoup
  • Requests

Consider linking to these videos Sophia made

Examples of resources that would be useful to include:

  • Web how-to/tutorial/walk-throughs
  • Youtube playlists or videos demonstrating tools
  • Links to blogs or platforms with subject matter experts

ryanmswan avatar Jan 21 '22 05:01 ryanmswan

Hey @henrykaplan , are you still working on this tutorial or should we put it back in the backlog to have someone else pick it up?

akhaleghi avatar Apr 08 '22 01:04 akhaleghi

Henry said at the meeting he is going to start this on 2022-05-02 with anticipated ETA of 2022-05-12

ExperimentsInHonesty avatar Apr 29 '22 03:04 ExperimentsInHonesty

Hey @henrykaplan is the ETA for this web scraping still today (5/12/22)?

akhaleghi avatar May 12 '22 20:05 akhaleghi

@akhaleghi No, I've been prioritizing it below the SEIE work. I can aim to have this by May 26 or we could reassign it if that would be faster.

henrykaplan avatar May 12 '22 21:05 henrykaplan

@henrykaplan Just checking in for a weekly update. Is this tutorial still on track for 5/26?

akhaleghi avatar May 19 '22 04:05 akhaleghi

@akhaleghi Yup, still on track for 5/26

henrykaplan avatar May 20 '22 04:05 henrykaplan

I've added the section we talked about in the May 26 meeting, recommendations for web scraping responsibly. The draft is ready to review.

henrykaplan avatar Jun 01 '22 19:06 henrykaplan

I've also taken APIs out of the description of the issue - that's a big enough topic that it should probably have its own tutorial.

henrykaplan avatar Jun 01 '22 19:06 henrykaplan

Hello @henrykaplan, I'm new to HFLA and glad to be here, Abe invited me to this project. I read the doc and thought I could build on it by making quick how-to-video- tutorials from simple to more complex, I'd keep them around 10 minutes. Let me know if/how we can use it. Here's the code I am working on and I'll give updates on videos too.

parcheesime avatar Jul 29 '22 05:07 parcheesime

Hello @henrykaplan,

I'm new to HFLA and glad to be here, Abe invited me to this project. I read the doc and thought I could build on it by making quick how-to-video- tutorials from simple to more complex, I'd keep them around 10 minutes. Let me know if/how we can use it. Here's the code I am working on and I'll give updates on videos too.

That sounds great to me!

henrykaplan avatar Jul 30 '22 03:07 henrykaplan

Hello @ryanmswan and @henrykaplan

Here's an update on the code I am working for code review. Part 1 and part of Part 2 are done. For now, these tutorials will only focus on Python and its packages, as referred to in the documentation.

parcheesime avatar Aug 13 '22 01:08 parcheesime

I've put the writeup on the wiki page. @parcheesime Feel free to add links & descriptions for your videos and code examples when you're ready.

@akhaleghi Should we close this issue, and create a new issue for the videos and working examples? Let me know.

henrykaplan avatar Sep 14 '22 21:09 henrykaplan

I'm almost finished with the code for the tutorial @ryanmswan and @akhaleghi, I just have one more that I'd like to do then I'll start recording. HERE are the notebooks for code review.

parcheesime avatar Sep 15 '22 06:09 parcheesime

Could anyone please review the tutorials before I record. HERE are the notebooks for code review.

parcheesime avatar Oct 14 '22 03:10 parcheesime