Ability to turn off proxy based on request url

[harshmaur]

Which package is the feature request for? If unsure which one to select, leave blank

@crawlee/core

Feature

We can currently configure a list of proxies and we can use a method to return a particular proxy url. However, it would be great to have the ability to turn off proxy completely dynamically.

Motivation

This is particularly useful where proxy can be used to load the website but we dont need proxy to load the scripts, css and images via proxy and usually these page resources take a lot of time and consume a lot of proxy bandwidth.

Ideal solution or implementation, and any additional constraints

In the newUrlFunction if we return undefined, then the proxy is not used at all.

Alternative solutions or implementations

No response

Other context

No response

[harshmaur]

I am happy to create a PR to help support this, I just need to know where to look and what to investigate there.