Add possibility to change "Total intervals" and/or "Refresh window" values from UI with 2 values "start_sync_date" and "end_sync_date"

[icychocolate98]

Good afternoon !

I have been using Jitsu for a while. I want to expose a feature idea on Facebook Source (but may be applied to any source).

One problem that I found is related to the possibility of download historical data from Facebook Source ( by default it only download 365 days before, for example I would like to have at least 2 years in this case.

In addition, for this source, people should be carefull due to Facebook API limits ( 200 calls * user in App / hour), this means that if you only have 1-2 users, you need to careful downloading 365 days because it will fail.

I think the best way is to add 2 new values in UI like "start_sync_date" and "end_sync_date" for example, so if anyone want to perform this operation could do it for any date ranges.

[vklimontovich]

Great idea! We probably will do it on a new version of facebook connector written in JavaScript. Also, it would probably make sense to introduce a rate limiter which sources can use:

/**
 * Service for implementing rate limiter
 */
declare type RateLimiter = {
  /**
   * Makes sure that subject won't do more than `permits` action per `timeUnit`  
   * 
   * @param subject subject of rate limit (usually API key or client id)
   * @param permits number of permitted actions
   * @param timeUnit
   */
  acquire(subject: string, permits: number, timeUnit: "hour" | "minute"): Promise<void>
};