AdguardForAndroid icon indicating copy to clipboard operation
AdguardForAndroid copied to clipboard

Custom content filter lists disappear after a certain amount of time

Open jo2dan94 opened this issue 2 months ago • 35 comments

Please answer the following questions for yourself before submitting an issue

  • [x] Filters were updated before reproducing an issue
  • [x] I checked the knowledge base and found no answer
  • [x] I checked to make sure that this issue has not already been filed

AdGuard version

4.14.3

Environment

  • OS version: android 16
  • Device: pixel 10 pro xl

HTTPS filtering

  • [ ] yes, I do

Root access

  • [ ] yes, I have it

Integration with AdGuard VPN

  • [ ] yes, I do

Routing mode

Local VPN

Ad Blocking

No response

Privacy

No response

Social

No response

Annoyances

No response

Security

No response

Language-specific

No response

Other

No response

Which DNS server do you use?

DNS protection disabled

DNS protocol

None

Custom DNS

No response

What Stealth Mode options do you have enabled?

No response

Issue Details

Steps to reproduce:

  1. Add a custom filter list
  2. Wait a couple hours
  3. It disappears

Expected Behavior

They stay

Actual Behavior

All 28 of my lists disappear this is insane!

Screenshots

Screenshot 1

Additional Information

No response

jo2dan94 avatar Nov 08 '25 16:11 jo2dan94

The only way I could reproduce this again was to get the app to crash with debug logs turned on. Logs sent

jo2dan94 avatar Nov 08 '25 20:11 jo2dan94

They just disappeared again but my logs weren't on. Learned my lesson about that hopefully this can be fixed

jo2dan94 avatar Nov 08 '25 21:11 jo2dan94

Hello, this sentence was entered in Japanese and translated into English using Google Translate. Therefore, there may be some mistakes, and I apologize for any such mistakes. Similar issues have been seen with custom DNS filters and extensions. It seems that they disappear when the lists are reloaded due to any filters update or something. thanks.

ShinyaReverse avatar Nov 09 '25 00:11 ShinyaReverse

Hello, this sentence was entered in Japanese and translated into English using Google Translate. Therefore, there may be some mistakes, and I apologize for any such mistakes. Similar issues have been seen with custom DNS filters and extensions. It seems that they disappear when the lists are reloaded due to any filters update or something. thanks.

Hello, thank you for your comment. You are absolutely right. I just updated and they all disappeared again. I have turned off automatic update until this is fixed

jo2dan94 avatar Nov 09 '25 00:11 jo2dan94

遇见过相同的问题,手动添加自定义规则后,前往用户规则查看未找到对应的规则,但是会正常进行拦截,从统计中看却未显示触发的规则

Encountered the same issue. After manually adding a custom rule, checking under user rules did not find the corresponding rule, but it still intercepts normally. However, the triggered rule does not appear in the statistics.

YHSanSheng avatar Nov 09 '25 13:11 YHSanSheng

遇见过相同的问题,手动添加自定义规则后,前往用户规则查看未找到对应的规则,但是会正常进行拦截,从统计中看却未显示触发的规则

Encountered the same issue. After manually adding a custom rule, checking under user rules did not find the corresponding rule, but it still intercepts normally. However, the triggered rule does not appear in the statistics.

但是清除应用数据后重新尝试却恢复了正常,不清楚应该如何复现问题,我猜测可能和旧版本覆盖安装新版本导致了某些配置错乱有关

However, after clearing the app data and trying again, everything returned to normal. I'm not sure how to reproduce the issue, but I suspect it may be related to installing a new version over an old version, which could have caused some configuration issues.

YHSanSheng avatar Nov 09 '25 14:11 YHSanSheng

遇见过相同的问题,手动添加自定义规则后,前往用户规则查看未找到对应的规则,但是会正常进行拦截,从统计中看却未显示触发的规则 Encountered the same issue. After manually adding a custom rule, checking under user rules did not find the corresponding rule, but it still intercepts normally. However, the triggered rule does not appear in the statistics.

但是清除应用数据后重新尝试却恢复了正常,不清楚应该如何复现问题,我猜测可能和旧版本覆盖安装新版本导致了某些配置错乱有关

However, after clearing the app data and trying again, everything returned to normal. I'm not sure how to reproduce the issue, but I suspect it may be related to installing a new version over an old version, which could have caused some configuration issues.

If I force stop the app then reopen it it says restarting protection and deletes the custom filter lists. Looks like theirs multiple ways to reproduce it

jo2dan94 avatar Nov 09 '25 16:11 jo2dan94

@KolbasovAnton could you take a look at this issue please?

jo2dan94 avatar Nov 10 '25 17:11 jo2dan94

Ok so here are the three ways to reproduce @KolbasovAnton

  1. You force stop the program and reopen it. Wait a couple minutes. Go to custom filters and they all will be gone.

  2. You check for filter updates. All custom filter lists disappear after the update

  3. You restart your phone completely. All filter lists will be gone upon opening adguard

jo2dan94 avatar Nov 10 '25 17:11 jo2dan94

If you can't reproduce it would you kindly try my filter list from my settings file. I'm guessing the reason you wouldn't be able to reproduce is because there is a current list limit that nobody has reached except me lmao

jo2dan94 avatar Nov 11 '25 14:11 jo2dan94

I'd like to add one thing I noticed about the filter disappearance issue. This occurred in 4.14 Nightly 1, which I rolled back from Nightly 2 & 3, which also had the filter disappearance issue mentioned above. When I exported my settings for backup, it seemed that some filters were not exported correctly when protection was disabled. These filters were the same ones that disappeared in Nightly, as mentioned above. I exported four extensions, but when I imported them, only zero were found. Judging from this behavior, it seems that there is a problem not only with custom-installed filters, but also with the processing of removable filters. This is because the non-removable filters included in the installer APK did not disappear, but the two removable extensions did.

ShinyaReverse avatar Nov 11 '25 16:11 ShinyaReverse

@jo2dan94 @ShinyaReverse @YHSanSheng We appreciate your feedback and your dedication to helping us make the product better! We've shared your input with the development team and are already focused on resolving this problem

oksenina avatar Nov 13 '25 13:11 oksenina

Thankyou!

Sent from Proton Mail for Android.

-------- Original Message -------- On Thursday, 11/13/25 at 07:01 Oksana Senina @.***> wrote:

oksenina left a comment (AdguardTeam/AdguardForAndroid#5906)

@.(https://github.com/jo2dan94) @.(https://github.com/ShinyaReverse) @.***(https://github.com/YHSanSheng) We appreciate your feedback and your dedication to helping us make the product better! We've shared your input with the development team and are already focused on resolving this problem

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

jo2dan94 avatar Nov 13 '25 13:11 jo2dan94

@jo2dan94 @YHSanSheng @ShinyaReverse Hello! We need some more information. Does the disappearing filters issue persist in version 4.12.1?

oksenina avatar Nov 14 '25 10:11 oksenina

I'm on the latest nightly and it's happening

Sent from Proton Mail for Android.

-------- Original Message -------- On Friday, 11/14/25 at 04:08 Oksana Senina @.***> wrote:

oksenina left a comment (AdguardTeam/AdguardForAndroid#5906)

@.(https://github.com/jo2dan94) @.(https://github.com/YHSanSheng) @.***(https://github.com/ShinyaReverse) Hello! We need some more information. Does the disappearing filters issue persist in version 4.12.1?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

jo2dan94 avatar Nov 14 '25 10:11 jo2dan94

Hello,all. I was already using 4.13 Nightly when 4.12 was released, so I don't know if the filter disappearance issue exists in 4.12, but it wasn't present in 4.13 Nightly. It started happening from 4.14 Nightly.

ShinyaReverse avatar Nov 14 '25 11:11 ShinyaReverse

Facing the same issue. Please fix it. It's really irritating with nightly abruptly stopping requiring the custom filters to be imported again and again.

Rtizer-9 avatar Nov 15 '25 07:11 Rtizer-9

@Rtizer-9 Hello! Does the disappearing filters issue persist in version 4.12.1? When did the issue with the disappearing filters first occur for you?

oksenina avatar Nov 17 '25 16:11 oksenina

It occurs in latest nightly

Sent from Proton Mail for Android.

-------- Original Message -------- On Monday, 11/17/25 at 10:36 Oksana Senina @.***> wrote:

oksenina left a comment (AdguardTeam/AdguardForAndroid#5906)

@.***(https://github.com/Rtizer-9) Hello! Does the disappearing filters issue persist in version 4.12.1? When did the issue with the disappearing filters first occur for you?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

jo2dan94 avatar Nov 17 '25 16:11 jo2dan94

@oksenina I don't think nor can I see that there was a intermediate 4.12.1 release. We've only started facing it recently from last 4.13 probably to recent 4.14 releases.

Also, it's really easy to check as some other user already mentioned.

Just install the suspicious release and force stop or probably quit the app and you'll see custom filters will be gone.

Rtizer-9 avatar Nov 19 '25 15:11 Rtizer-9

Since this is a display issue with custom filters, I was considering adding this here or in #5902, but since it doesn't occur with DNS filters, I'll post it here. First, please take a look at the attached image. The version number, 20251118, listed in the filter text is not reflected on the filter list page, but is instead 20250926. This issue began around 4.13 Nightly and continues through the current 4.14 Nightly. As you might expect, it seems that the update date and time are being used as the version number. There have been several updates to both Nightly and the filters, and none of them have displayed the correct version. This appears to be a bug, so I would appreciate it if you could fix it at some point. Thank you.

Image Image Image

ShinyaReverse avatar Nov 20 '25 00:11 ShinyaReverse

@Rtizer-9 @jo2dan94 @ShinyaReverse @YHSanSheng Hello! Thank you for actively helping us find and fix the bug with disappearing filters. We are already working on resolving it. Could you please tell us if this bug is still recurring in version 4.14.7 Nigthly?

oksenina avatar Nov 20 '25 10:11 oksenina

@ShinyaReverse Hello! Please send us the logs that include the filter update process so we can thoroughly investigate the issue with the filter version mismatch

Here's what we need you to do: Enable debug logging: Settings -> General -> Advanced -> Logging level -> Debug Reproduce the problem, then remember the exact time when it happened Collect logs: Settings -> General -> Advanced -> Export logs and system info Send this file to [email protected]: Include the [android] keyword and 5906 in the subject of your email Specify the exact time when the issue occurred

oksenina avatar Nov 20 '25 11:11 oksenina

@ShinyaReverse Hello! Please send us the logs that include the filter update process so we can thoroughly investigate the issue with the filter version mismatch

@oksenina https://github.com/AdguardTeam/AdguardForAndroid/issues/5906#issuecomment-3555178185 When I reported the bug here, I decided that the filter I gave as an example was not updated frequently and therefore was not suitable for investigation. Therefore, I registered two new filters and used those to obtain logs. Due to this, the logs are limited to the time before and after the filter update. This was for about one minute between 8:05 AM and 8:06 AM Japan time on November 21st. What do you think? Thank you in advance.

ShinyaReverse avatar Nov 20 '25 23:11 ShinyaReverse

@oksenina it's still recurring in the latest nightly 4.14.9 as well. You just need to force stop the app and the custom filters will be gone.

Is it possible that the new cache control method you deployed to keep the huge size in check might be causing this?

Fyi I do make heavy use of custom filters but they've very few entries as compared to some huge adblock filters which are completely nonsense and contain millions of entries.

Rtizer-9 avatar Nov 21 '25 09:11 Rtizer-9

@Rtizer-9 Hello! Please send us the logs that include app's force stopping so we can thoroughly investigate the issue with the filter disappearance

Here's what we need you to do: Enable debug logging: Settings -> General -> Advanced -> Logging level -> Debug Reproduce the problem, then remember the exact time when it happened Collect logs: Settings -> General -> Advanced -> Export logs and system info Send this file to [email protected]: Include the [android] keyword and 5906 in the subject of your email Specify the exact time when the issue occurred

oksenina avatar Nov 21 '25 09:11 oksenina

@oksenina so I tried to collect the logs to send you and the error was reproduced one time but now when I'm even force stopping again and again and clearing cache and things like that; the error can't be reproduced surprisingly. Something definitely happened in recent nightlies because in just few nightlies before it happened just after force stopping.

I'll try to monitor it and as soon as it happens again and I get a clue of what's causing it, I'll turn debug logging and send you 👍.

Rtizer-9 avatar Nov 21 '25 15:11 Rtizer-9

@Rtizer-9 Thank you for your effort!

oksenina avatar Nov 21 '25 15:11 oksenina

I will try in a bit

Sent from Proton Mail for Android.

-------- Original Message -------- On Friday, 11/21/25 at 09:21 Oksana Senina @.***> wrote:

oksenina left a comment (AdguardTeam/AdguardForAndroid#5906)

@.***(https://github.com/Rtizer-9) Thank you for your effort!

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

jo2dan94 avatar Nov 21 '25 15:11 jo2dan94

@jo2dan94 Thank you! Appreciate it!

oksenina avatar Nov 21 '25 15:11 oksenina