PromptClip
PromptClip copied to clipboard
Instantly create video clips from LLM prompts
PromptClip β
Create video clips using LLM prompts
πReport a Bug
Β·
π‘Suggest a Feature
PromptClip: Create Instant Video Clips with LLM Prompts π
What does it do? π€
It allows any developer to:
- π Upload a video from any source (Local Files, Youtube, S3 etc.)
- π Prompt that video in natural language with queries like
Show funny moments in the videoorfind the moments useful for social media trailer - ποΈ Use any LLM of your choice like OpenAI, Claude or Gemeni Pro.
- π Instantly watch the clip of those moments.
- π οΈ Finetune the clip or supercut by ranking results, managing length of the clip etc.
- πΈ Add music or image overlay to the clip.
Results π
Checkout these prompts and the results ππΌ
| Original Video | Prompt | Link |
|---|---|---|
| Shark Tank | Find every moment where a deal was offered | watch |
| Useful Gadgets | Show me moments in the video where the host discusses or reveals the pricing of the gadgets | watch |
| Sponsorship Details of Huberman Podcast | Find details about every sponsor | watch |
| Highlights from Masterchef Episode | Show me the feedback from every judge | watch |
| Important Topics/Advice from a Lecture | Find sentences where anxiety is discussed | watch |
| Tech Review Video | Find sentences where host explains about the battery | watch |
| Travel Video | What are some popular tourist destinations in Sri Lanka | watch |
How do I use it? π οΈ
- Get your API key: Sign up on VideoDB console (Free for the first 50 uploads, no credit card required). π
- Set
VIDEO_DB_API_KEY: Enter your key in theenvfile. - Set
OPENAI_API_KEYorANTHROPIC_KEY: Add your LLM API Key in theenvfile. - Install dependencies: Run
pip install -r requirements.txtin your terminal. - Run locally: Run the notebook
PromptClip.ipynband experiment with your prompts and ranking of results.
Roadmap π£οΈ
- Add support for music generation models to jazzup the cuts.
- Integrate with other projects like Pika Labs and Midjourney.
- Add support for Text Overlays from VideoDB.
Contributing π€
Your contributions make the open-source community an incredible place for learning, inspiration, and creativity. We welcome and appreciate your input! Here's how you can contribute:
- Open issues to share your use cases.
- Participate in brainstorming solutions for our roadmap.
- Suggest improvements to the codebase.
Contribution Steps
- Fork the Project π΄
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request π¬