splitrb
Number of participants exceeds page views
Hi there! We recently added Split to our project and have noticed that the number of participants far exceeds the number of page views that we've recorded by as much as 4 times.
I read through the issues in this repo and found something similar reported in #302, but there was not much activity and the issue was subsequently closed.
Has anyone else experienced this issue? If so, do you have any idea what may be causing it?
This might be because of the way Split handles test-resets after a user converts. https://github.com/splitrb/split#reset-after-completion
The ab_finished method has the option reset defaulting to true, this determines if a user will start another test session (ie: become a new participant).
You can pass the option reset:false to your ab_finished method, and it should solve this issue
Same issue. Adding reset: false didn't fix it for me. The traffic is coming from some Paid FB Campaigns. I added the Facebot and other bots on ignore list and still have the same behaviour.
Seeing Participants almost 6 times more than real FB clicks.
Anyone found a solution yet? Seeing the same, the test is set up with resettable: false in the yaml config.
