Add support for easy logging setup with sensible defaults

[bhimrazy]

🚀 Feature

Add support for easy logging setup with sensible defaults

Description: Add a configure_logging utility (like LitServe’s version)

• Set logging level (default INFO) in init, like in litserve or pytorch lightning.
• Use clean format and sys.stdout stream
• Optional use_rich=True for pretty logs
• Show only important progress/info logs by default; move other logs to DEBUG

Example:

from litdata import configure_logging
configure_logging(level="INFO", use_rich=True)

Benefit: Cleaner, more useful logging out of the box.

cc: @tchaton @deependujha

[sanggusti]

Hi @bhimrazy I would like to try some contribution on this issue. I've attached my PR with test samples. I hope you can review it when you can

[bhimrazy]

Sure, thanks @sanggusti for opening the PR! I’ll review it shortly.