Sitediff init not creating Paths.txt

[Saibot97]

Hello,

I just installed Sitediff on a fresh Ubuntu VM with Ruby 2.6.6. When i run the Sitediff init command, tried with a few webpages, it just creates the sitediff.yaml, no paths.txt at all.

[kdborg]

sitediff init https://4nes.com will create the initial file. sitediff crawl will crawl the site and create the paths.txt file.

[Saibot97]

Okay, i got it now. The page im accessing has an htaccess and a normal login area. The .htaccess got managed in url like: username:password@url But is there a way to give sitediff user credentials for a login area ?

[kirk-brown-ew]

In your sitediff.yml file you can add credentials to the curl options:

settings:
  curl_opts:
    userpwd: "username:password"

[Saibot97]

Putted the credentials for the login Area in the settings like you said, but still get the same error when try to crawl.

The Error:

And this is the Login-Area i need to pass

[kirk-brown-ew]

Those credential settings are for Basic HTTP Auth.

There isn't a way to log in via a form just yet.