⚡️ Lightning AI

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Lightning-AI

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Lightning-AI

Deep Learning Fundamentals -- Code material and exercises

Lightning-AI

Python pdb for multiple processes

Lightning-AI

Lightning support for Intel Habana accelerators.

Lightning-AI

Frontend for Lightning apps and home of the Design System

Lightning-AI

Blazingly fast, distributed streaming of training data from any cloud storage for training AI models

Lightning-AI

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

Lightning-AI

Lightning-fast serving engine for AI models. Flexible. Easy. Enterprise-scale.

Lightning-AI