adrianshort
adrianshort
I'm running version 20220131195043-17.5.0-6d8b434-linux/arm on a low-spec Raspi model 1B+ (650MHz CPU, 430MB RAM). The site is enabled and serving some static pages to the web. After rsyncing from my...
Currently from these lines in northgate.rb: ```ruby results_url = URI::encode(base_url + response2.headers['Location'].gsub!('PS=10', 'PS=99999')) app.info_url = URI::encode(generic_url + cells[0].at('a')[:href].strip) ``` We need to improve the URL escaping by understanding what's precisely...
How to reproduce: ```ruby auth = UKPlanningScraper::Authority.named("X") # Northgate authorities only apps1 = auth.case_officer_code("123").decided_days(7).scrape apps2 = auth.decided_days(7).scrape ``` This fails because the `url` param of `Authority` has been modified so...
``` Getting: https://www.planningpa.bolton.gov.uk/online-applications-17/search.do?action=advanced /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/net/http.rb:933:in `connect_nonblock': SSL_connect returned=1 errno=0 state=unknown state: unknown protocol (OpenSSL::SSL::SSLError) from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/net/http.rb:933:in `connect' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/net/http.rb:863:in `do_start' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/net/http.rb:858:in `start' from /app/vendor/bundle/ruby/2.3.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:692:in `start' from /app/vendor/bundle/ruby/2.3.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:622:in `connection_for' from /app/vendor/bundle/ruby/2.3.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:927:in...
Currently the Northgate scraper throws a fatal error when getting a 301/302 redirect on the first scrape. We should follow the redirect rather than fail. This has been an issue...
eg Northern Ireland: http://epicpublic.planningni.gov.uk/publicaccess/search.do?action=advanced&searchType=Application which is an Idox site that has a param called `searchCriteria.localGovernmentDistrict`. An alternative approach would be to list each authority separately in `authorities.csv` and add extra...
Should be 32 but only gets 31: https://kiosks.adrianshort.org/authorities/aberdeen/ (Reported by @NotQuiteMinerva)
- [ ] applicant_name - [ ] application_type - [ ] development_type
[Semantic versioning 2.0.0](https://semver.org) says: > Given a version number MAJOR.MINOR.PATCH, increment the: > > MAJOR version when you make incompatible API changes, > MINOR version when you add functionality in...
Tests should fail if there is a duplicate authority name. Not sure about duplicate authority URLs. Do any authorities share the same planning website?