Support for multiple, scalable data sources - Spark based data sources.

[ckarwicki]

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Would like to have support for multiple, configurable Spark based data sources. That would allow sourcing features from multiple data stores. We would like to source features from S3, Snowflake, Postgres and have consistent feature repository.

Describe the solution you'd like A clear and concise description of what you want to happen.

Spark source support for configuring things line jdbc driver, database connection string, query. Each source could then point to different data store and get data efficiently and asynchronously.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered. No solution yet to be able to source from multiple data stores.

Additional context Add any other context or screenshots about the feature request here.

[cburroughs]

See also #2121.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.