Dates and time

[dalmaer]

I often see questions that involve time.

When was the first time X?

Between 2022 and 2023 Y?

Can we do more with dates and time... Eg

• add the date of a source into info?
• add the date into some of the embeddings?

Similar: versions where appropriate.

[jkomoros]

The design for #18 also sketched out how to handle timestamps and date filtering, and glancing at it now I think it still holds up

[dalmaer]

That's great. Makes sense for times/dates. As soon as we get into more querying it makes me stare at pinecone even more.

index.query(
    vector=[0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1],
    filter={
        "genre": {"$eq": "documentary"},
        "year": 2019
    },
    top_k=1,
    include_metadata=True
)

Are we good with supporting custom metadata in your library? E.g. genre above etc. I have been using that for things like ... storing docs for different versions of a SDK etc.