http-crawler icon indicating copy to clipboard operation
http-crawler copied to clipboard

Allow user to choose how links are extracted from responses

Open inglesp opened this issue 9 years ago • 1 comments

We currently extract links from HTML by looking for src and href attributes, and from CSS by looking for @import rules and URI tokens.

A user might want to extract links from other places, such as data- attributes in HTML, or values in JSON objects.

We should find a way to allow the user to configure how links are extracted from responses.

inglesp avatar Jun 09 '16 11:06 inglesp

I would like to tackle this issue. 😃

shahzeb1 avatar Mar 02 '17 04:03 shahzeb1