on-chain

So is there any simple way to pass `anyhow::Error` in a place which expects `impl std::error::Error` or has a `from std::error::Error` ?... Getting `thiserror` crate involved just for this seems...

I've added templateUrl support (first it checks templateCache if not found loads template via $http)

Hi @rtrevinnoc ! Thanks for taking interest in the project. Right now crusty does Not persist any direct page data, but the data itself is easily available in code through...

Crusty is nothing more that a bunch of code as configuration for crusty-core and a handler of IO I think u'd be interested mostly in implementing a `TaskExpander` interface, getting...

Could be redirect related... Often we would get a redirect to a subdomain or even totally different domain - which we treat as job bounds violation, => meaning we've spent...

Plan is. 1. Dedicated DNS resolver pools - capacity splited between seeding and domain discovery 2. Newly started job is a seed and it's first task will be using seeding...

Should handle this together with https://github.com/let4be/crusty/issues/3 When things with new features/stability settle a bit

Hm... on another try it gives me this ``` -- Found Python: /usr/bin/python3.8 (found version "3.8.6") found components: Interpreter -- Configuring done CMake Error at CMakeLists.txt:62 (add_executable): Target "robots-test" links...

found this in `CMakeLists.txt.in` ``` ExternalProject_Add(abseilcpp GIT_REPOSITORY https://github.com/abseil/abseil-cpp.git GIT_TAG master GIT_PROGRESS 1 SOURCE_DIR "${CMAKE_CURRENT_BINARY_DIR}/libs/abseil-cpp-src" BINARY_DIR "${CMAKE_CURRENT_BINARY_DIR}/libs/abseil-cpp-build" CONFIGURE_COMMAND "" BUILD_COMMAND "" INSTALL_COMMAND "" TEST_COMMAND "" ) ``` it's never a good...

changing https://github.com/Folyd/robotstxt/blob/d46c028d63f15c52ec5ebd321db7782b7c033e81/tests/CMakeLists.txt.in ``` ExternalProject_Add(abseilcpp GIT_REPOSITORY https://github.com/abseil/abseil-cpp.git GIT_TAG 20200923.2 GIT_PROGRESS 1 SOURCE_DIR "${CMAKE_CURRENT_BINARY_DIR}/libs/abseil-cpp-src" BINARY_DIR "${CMAKE_CURRENT_BINARY_DIR}/libs/abseil-cpp-build" CONFIGURE_COMMAND "" BUILD_COMMAND "" INSTALL_COMMAND "" TEST_COMMAND "" ) ExternalProject_Add(googletest GIT_REPOSITORY https://github.com/google/googletest.git GIT_TAG release-1.10.0 GIT_PROGRESS 1...