Erni Durdevic

Support window operations on Structured Streaming data sources

1

At the moment, Spark does not support window functions (like `lag` or `head`) on a stream. It would be great if you could add support for those type of operation.

**Is your feature request related to a problem? Please describe.** Ensure the Quick Start notebooks are always reliable **Describe the solution you'd like** On every commit, execute the Quick Srtart...

Refactored project structure to comply to Databricks Labs blueprint standard. - Added pyproject.toml - Refactored namespace - Added custom __init__.py - Aligned version file format and changelog format

Added new workflow bundle workflow_vector_search_ingestion_for_rag Based on #111 by @bali0019, this pipeline adds chunking and vector search index creation by using the patterns from the [AI cookbook documentation example](https://docs.databricks.com/aws/en/generative-ai/tutorials/ai-cookbook/quality-data-pipeline-rag)