Overpass-API icon indicating copy to clipboard operation
Overpass-API copied to clipboard

https://dev.overpass-api.de/clone/latest_dir contains wrong URL

Open swiss-chris opened this issue 10 months ago • 1 comments

I hope I found the right place for this issue. If not please advise whom to contact instead.

I assumed this might be the correct place because of these search results: https://github.com/search?q=repo%3Adrolbr%2FOverpass-API%20latest_dir&type=code

https://dev.overpass-api.de/clone/latest_dir currently returns https://dev.overpass-api.de/clone//2025-03-08, but https://dev.overpass-api.de/clone/ only contains

  • 2025-03-05
  • 2025-03-10
  • latest_dir

This breaks overpass installations like this one

https://github.com/wiktorn/Overpass-API?tab=readme-ov-file#overpass-clone-covering-whole-world

docker run
-e OVERPASS_META=yes
-e OVERPASS_MODE=clone
-e OVERPASS_DIFF_URL=https://planet.openstreetmap.org/replication/minute/
-v /big/docker/overpass_clone_db/:/db
-p 12346:80
-i -t
--name overpass_world
wiktorn/overpass-api

with errors like this

--2025-03-11 15:45:53-- https://dev.overpass-api.de/clone//2025-03-08/replicate_id Resolving dev.overpass-api.de (dev.overpass-api.de)... 95.217.37.171, 2a01:4f9:2b:2fd4::2 Connecting to dev.overpass-api.de (dev.overpass-api.de)|95.217.37.171|:443... connected. HTTP request sent, awaiting response... 404 Not Found 2025-03-11 15:45:53 ERROR 404: Not Found.

swiss-chris avatar Mar 11 '25 16:03 swiss-chris

Hello,

As @swiss-chris reported, there is a significant instability with the cloning mechanism when working with https://dev.overpass-api.de.

The https://dev.overpass-api.de/clone/latest_dir file might point to a nonexistent or empty directory.

Sometimes, even when an existing and non-empty folder is pointed to by latest_dir, the directory contents might be incomplete.

In my case, https://dev.overpass-api.de/clone/2025-11-25 lacks a required replicate_id file. A new instance of an Overpass server would not start in the clone mode, because the absence of replicate_id makes the cloning process stuck. See https://github.com/drolbr/Overpass-API/blob/a0db4f392f744d5e1304331edbf542ef6d6ce2fa/src/bin/download_clone.sh#L116C57-L116C69 for reference.

Thank you!

sindilevich avatar Nov 25 '25 07:11 sindilevich