Generative Manim
GPT for video generation
⚡️ How it works
Making video animations accessible to everyone.
Generative Manim is an open-source tool for generating animation videos from text. It is divided in three parts:
- Generate Video: Generate the video from the text.
- Render Engine: Render the video from the code.
- Prompt Generator: Generate the code from the text.
The Generate Video part is the sum of the Prompt Generator and the Render Engine in a single step.
💡 Concept
Imagine a future where you can watch an animation video from a concept you have in your mind in a few seconds. That would be useful for teachers, students, and more. People that want to generate a video won't need to learn how to use a video editor, how to draw, or how to code. You just need to write a descriptive text.
That indeed is a future. And it is not that far. We can already start working on it.
Manim is a Python library for creating complex graphics and animations. The main advantage of Manim for GPT, it's that since it's a language for the LLM, it's more easy to generate proper code from a prompt.
💻 Models
The models we use to generate Manim code from text.
Generative Manim uses models to generate code from text. The first model we used was GPT-4 with a Zero Shot Learning strategy. Today we are using two models.
🤖 GPT-4o
GPT-4o is the next-generation model from OpenAI. We use a basic system prompt to generate the code. We add a few extra instructions to help the model understand the task.
📡 GPT-3.5 Fine-Tuned
We trained a GPT-3.5 model with a few examples of Manim code. The model is fine-tuned to generate Manim code from a prompt. This model is a little bit slower than GPT-4o.
🕹️ Other models
We are currently working on creating new models to integrate with Generative Manim.
If you have an idea or want to help us, go to our Discord Community and let us know.
🚀 Contributors
Awesome people that are contributing to the project.
Generative Manim is an open source project. You can contribute to the project by suggesting new features, fixing bugs, or improving the documentation. Pull Requests are warmly welcome.
Remember you can also join our Discord Community to discuss new features, bugs or any other topic.