arska-node icon indicating copy to clipboard operation
arska-node copied to clipboard

Check and report price update issues here

Open Olli69 opened this issue 1 year ago • 20 comments

If you have problems with getting price info from Entso-E or Elering (Finland & Baltic) you can report the issue here. Currently there is no known technical issues with the latest version of Arska 1.1.0-beta11.

If there are problems in getting price data to Arska

  • Check you that your internet connection is ok. Restart Arska device.
  • Check if there are any problems reported (here).
  • If in Estonia, Finland, Latvia or Lithuania , you can also switch between price source. For Entso-E you need an API-key.
  • If valid price data for selected date is available in the source (Entso-E or Elering) but not in Arska, there is possible problem with Arska. Please, report it here.

How to check if price info is available from your selected source

Entso-E

Login to Entso-E Transparency Platform and check if the price data is available for selected date and area.

Test Elering data availability (ee, fi, lv, lt)

  • Go to Elering dashboard API documentation page .
  • Press "Try it out" on section /api/nps/price/csv, enter start and end dates as well as country information. Press "Execute"
  • Download result file and check if there are valid price information (one row per an hour) in the file.

Olli69 avatar Dec 05 '24 10:12 Olli69

Price data is not available from Elering for Dec 5 2024. Tested with url https://dashboard.elering.ee/api/nps/price/csv?start=2024-12-04T20%3A59%3A59.999Z&end=2024-12-05T20%3A59%3A59.999Z&fields=fi Edit Dec 5, 17:00: Prices for Dec 5 and Dec 6 are now available from Elering.

Olli69 avatar Dec 05 '24 10:12 Olli69

Price data is not available from Entso-E for Jan 20 2025. I sent also notification about the problem to [email protected] . Tested with URL (Jan 19,20:25 EET) https://newtransparency.entsoe.eu/market/energyPrices?appState=%7B%22sa%22%3A%5B%22BZN%7C10YFI-1--------U%22%5D%2C%22st%22%3A%22BZN%22%2C%22mm%22%3Atrue%2C%22ma%22%3Afalse%2C%22sp%22%3A%22HALF%22%2C%22dt%22%3A%22CHART%22%2C%22df%22%3A%222025-01-20%22%2C%22tz%22%3A%22CET%22%7D .

Prices available from Elering for EE,FI,LT,LV,LT.

Edit: Heldesk announced afternoon Jan 20 that problem is fixed,

Olli69 avatar Jan 19 '25 18:01 Olli69

Price data is no longer available from Entso-E: https://transparency.entsoe.eu/transmission-domain/r2/dayAheadPrices/show?name=&defaultValue=false&viewType=GRAPH&areaType=BZN&atch=false&dateTime.dateTime=25.04.2025+00:00|EET|DAY&biddingZone.values=CTY|10YAT-APG------L!BZN|10YAT-APG------L&resolution.values=PT15M&resolution.values=PT30M&resolution.values=PT60M&dateTime.timezone=EET_EEST&dateTime.timezone_input=EET+(UTC+2)+/+EEST+(UTC+3)

New version is: https://newtransparency.entsoe.eu/market/energyPrices Can Arska get prices from here?

SapeHuh avatar Apr 25 '25 05:04 SapeHuh

Price data is no longer available ... New version is: https://newtransparency.entsoe.eu/market/energyPrices Can Arska get prices from here?

Arska is getting price info from Entso-E API url (web-api.tp.entsoe.eu), so web url change (transparency.entsoe.eu to newtransparency.entsoe.eu) does not affect it directly, even if it is using the same data. Arska can use also Elering price data as backup (for EE, FI, LT, LV price zones).

Arska version 1.3 (currently in alfa testing phase) supports 15-minute Market Time Unit (MTU), going live 11 June 2025.

Olli69 avatar Apr 25 '25 06:04 Olli69

Ok, thanks. I just started wondering because both yesterday and today I noticed that on during highest price hours my geothermal heat pump was running and arska had error message from price datas.

SapeHuh avatar Apr 25 '25 06:04 SapeHuh

Ok, thanks. I just started wondering because both yesterday and today I noticed that on during highest price hours my geothermal heat pump was running and arska had error message from price datas.

1.1.0-alfa16 and 1.1.0-beta17 versions should be working with both data sources, EntsoE and Elering (backup source for Fi+Baltic). If you have still errors (and have tested network connections, EntsoE api keys ...), please send the error message here.

Olli69 avatar Apr 25 '25 16:04 Olli69

I'm having problems eith price with latest version. Price is showing huge value, propably some maximum value. Restarting does not help. Is there something wrong right now, or?

stikstone avatar May 20 '25 18:05 stikstone

@stikstone, I checked several running Arska instances and they seem to have prices ok - mostly from Elering. But currently EntsoE sites https://web-api.tp.entsoe.eu/ and https://newtransparency.entsoe.eu/ seem to be down - do not know if this has anything to do with the problem. What is exact value of the huge price? Value could give hint of the problem, if it is internal problem. So, you restarted with "Restart and clear cache"?

Image

Olli69 avatar May 20 '25 20:05 Olli69

Value is 2147483.5 ¢/kWh

It was working correctly yesterday, and i think it even worked earlier today.

ti 20.5.2025 klo 23.06 Olli @.***> kirjoitti:

Olli69 left a comment (Netgalleria/arska-node#45) https://github.com/Netgalleria/arska-node/issues/45#issuecomment-2895700526

@stikstone https://github.com/stikstone, I checked several running Arska instances and they seem to have prices ok - mostly from Elering. But currently EntsoE sites https://web-api.tp.entsoe.eu/ and https://newtransparency.entsoe.eu/ seem to be down - do not know if this has anything to do with the problem. What is exact value of the huge price? Value could give hint of the problem, if it is internal problem.

— Reply to this email directly, view it on GitHub https://github.com/Netgalleria/arska-node/issues/45#issuecomment-2895700526, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4MEP5QJO7UPBPQM35W5O7327ODLNAVCNFSM6AAAAABTCCOYBCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDQOJVG4YDANJSGY . You are receiving this because you were mentioned.Message ID: @.***>

stikstone avatar May 20 '25 20:05 stikstone

And now i see the value seems to be negative, but the same for all hours. And yes, made the restart with clear cache for a few times since after last update it also had some hickups with getting the price.

Price data is from elring now, but it was not showing it before.

ti 20.5.2025 klo 23.09 turkka kivelä @.***> kirjoitti:

Value is 2147483.5 ¢/kWh

It was working correctly yesterday, and i think it even worked earlier today.

ti 20.5.2025 klo 23.06 Olli @.***> kirjoitti:

Olli69 left a comment (Netgalleria/arska-node#45) https://github.com/Netgalleria/arska-node/issues/45#issuecomment-2895700526

@stikstone https://github.com/stikstone, I checked several running Arska instances and they seem to have prices ok - mostly from Elering. But currently EntsoE sites https://web-api.tp.entsoe.eu/ and https://newtransparency.entsoe.eu/ seem to be down - do not know if this has anything to do with the problem. What is exact value of the huge price? Value could give hint of the problem, if it is internal problem.

— Reply to this email directly, view it on GitHub https://github.com/Netgalleria/arska-node/issues/45#issuecomment-2895700526, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4MEP5QJO7UPBPQM35W5O7327ODLNAVCNFSM6AAAAABTCCOYBCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDQOJVG4YDANJSGY . You are receiving this because you were mentioned.Message ID: @.***>

stikstone avatar May 20 '25 20:05 stikstone

The value seems to missing/unknown value i.e. it seems that Arska does not get price data but show initial values. Just now I do not have idea what exactly could cause the problem, because I cannot repeat the problem. If the price query is canceled (gets connection but no data) for some reason, could possibly cause something like that -but why would it happen multiple times...

Please let me know is there is more info or it gets somehow fixed. I'll try to think, in what situation that could happen.

Olli69 avatar May 20 '25 20:05 Olli69

Problem persists. Did a restart again this morning.

image

stikstone avatar May 21 '25 07:05 stikstone

Restart once more, and now i got the price data again.

Also it seems to get the price from primary, instead of Elring.

Maby there was some problem with those. image

stikstone avatar May 21 '25 09:05 stikstone

@stikstone , thanks for reporting and good that it is working! Anyway strange behaviour and it could be linked somehow to problems with EntsoE availability. If possible, could you send me([email protected]) your config(Backup configuration), so I could try to replicate the error. EDIT: Seems that if a query to EntsoE failed and then Elering did not receive all requested prices, situation like that could have occurred. I'll making some checks and testing them... Of course if neither of these give price data, we will be missing it, but there should be wrong values like in this case have been.

Olli69 avatar May 21 '25 09:05 Olli69

I sent the config file for testing. Hope it helps.

stikstone avatar May 21 '25 09:05 stikstone

1.3.0-beta4 should be more robust if there are errors in getting prices. It does more checks before it replaces current price data with just imported new data. So, failure in the middle of price query does not clear all the price data. Earlier problem with extreme values (e.g. 2147483.5 ¢/kWh, special value was not recognised) is also fixed.

Olli69 avatar May 23 '25 20:05 Olli69

Hello Olli,

I just noticed that q1 in hour 08:00 2025-10-14 is wrong in se3, it reads 8,8 but should be like 23,6,

Image

//Jonas

joe-ave avatar Oct 13 '25 19:10 joe-ave

Hi Jonas, That is a strange drop in the price. I just tested with SE3 (times in the first image EET, second UTC) and it seems to be right.

Image

According to Entso-E the data has not changed since the initial update. Maybe a random data communications error 🤔

Image

Olli69 avatar Oct 14 '25 06:10 Olli69

Yes I restarted the Arska node this morning and then the error was corrected. So it was a thing that existed for a while in the pricefile yesterday but not on their webpage.

joe-ave avatar Oct 14 '25 17:10 joe-ave

Hej @joe-ave, I found the problem - hope so... We had yesterday similar price drop in FI BZ 22:00-22:15 (EET), which disappeared later. The price data just happened to be in the middle of two separate data chunks and reading process could not handle it. 15-minute pricing caused longer files and risk for these cases increased. Now chunked data (used in Entso-E long XML price files) response processing is rewritten and there should not be similar problems in the future.

Olli69 avatar Oct 18 '25 19:10 Olli69