Open-source motion studio — 20 repos for agent-built video
Hub for 20 open-source repositories that Arminas Valunas listed in a LinkedIn post on 2026-10-26
(“20 open-source repos. A full motion studio. Free.”). His claim: load them into a coding agent as
skills and you cover animation, physics, 3D, sound and captions. The “Post’s description” column in
the table is his one-liner; everything else in this note and in the linked notes was checked on
2026-10-27 against each repository’s README, license file, releases and registry entries. Method: each repository’s README, license file, releases and registry entries.
The 20 repositories
| # | Repo | Post’s description | Layer | Note |
|---|---|---|---|---|
| 01 | Remotion | React video engine | Rendering | Remotion; comparison in rendering |
| 02 | HyperFrames | HTML-to-video renderer | Rendering | HyperFrames |
| 03 | Anime.js | Timeline choreography | Animation | Anime.js |
| 04 | React Spring | Spring animation | Animation | React Spring |
| 05 | PixiJS | GPU-powered 2D graphics | 2D graphics | PixiJS |
| 06 | p5.js | Generative visuals | 2D graphics | p5.js |
| 07 | Paper.js | Vector paths | 2D graphics | Paper.js |
| 08 | Matter.js | 2D physics | Physics | Matter.js |
| 09 | Three.js | 3D scenes | 3D | Three.js |
| 10 | Rapier | 3D collisions | Physics | Rapier |
| 11 | OGL | Custom shaders | 3D / shaders | OGL |
| 12 | tsParticles | Particle effects | Effects | tsParticles |
| 13 | glTF Transform | 3D asset optimization | 3D | merged into 3D and shader libraries compared |
| 14 | GL Transitions | Shader transitions | Effects | merged into particle and transition effects compared |
| 15 | OBS Studio | Screen capture | Capture | OBS Studio |
| 16 | Chatterbox | Voiceovers | Voice | Chatterbox; see also Text-to-speech |
| 17 | Tone.js | Synths and sound effects | Sound synthesis | Tone.js |
| 18 | faster-whisper | Caption transcription | Captions | faster-whisper; see also Whisper and ASR models |
| 19 | OpenCut | Timeline editing | Editing | OpenCut |
| 20 | FFmpeg | Encoding and delivery | Encoding | FFmpeg |
Per-layer comparisons (each ends in a “which one when” section):
Rendering ·
Animation ·
2D graphics ·
Physics ·
3D and shaders ·
Effects.
The single-entry layers (capture, voice, sound, captions, editing, encoding) are compared inside
each repo note’s “Pick something else when” section.
Remotion already had a note, so no second one was written; its comparison lives in the rendering
note and remotion.md links back here.
Stack at a glance
- Remotion: React components to video with a Player, Lambda and client-side rendering; the license is source-available with a company tier. Pick it for ecosystem and tooling.
- HyperFrames: HTML to deterministic MP4 via headless Chrome and FFmpeg; Apache-2.0, agent skills, about 450 catalog blocks. Built for agents.
- Anime.js: timeline choreography of CSS, SVG and objects; useful as a HyperFrames adapter.
- React Spring: spring physics for React interaction; wrong shape for fixed-duration video.
- PixiJS: GPU 2D scene graph with filters; strongest 2D option for heavy scenes.
- p5.js: sketch-style generative art; LGPL-2.1.
- Paper.js: vector path geometry, also in Node.
- Matter.js: friendly 2D rigid bodies; slow release cadence.
- Three.js: the broadest 3D ecosystem; a named HyperFrames adapter.
- Rapier: 2D/3D Rust physics with WASM builds.
- OGL: minimal WebGL for custom shaders; quiet since 2025-04.
- tsParticles: config-driven particle effects with many presets.
- glTF Transform: scriptable glTF file editing and optimisation; no renderer.
- GL Transitions: 100+ shader transitions with a Remotion package and an agent skill.
- OBS Studio: live capture and streaming; GUI-first.
- Chatterbox: local zero-shot voice cloning TTS, with a CPU-capable Nano model and a built-in watermark.
- Tone.js: Web Audio synthesis and scheduling for music and effects.
- faster-whisper: Whisper on CTranslate2 with word timestamps; the captions step.
- OpenCut: open timeline editor mid-rewrite; agent features planned, not shipped.
- FFmpeg: the universal encode and mux step.
What an agent actually needs
Minimal script-to-MP4 subset (assessment): a renderer (HyperFrames or Remotion) + FFmpeg (required by both) + Chatterbox for narration + faster-whisper for caption timing. Everything else is optional material that goes inside a composition.
Duplicates: HyperFrames and Remotion do the same job (choose one per project). Anime.js and React Spring both animate values; React Spring requires React so only fits Remotion. PixiJS, p5.js and Paper.js overlap on 2D. Matter.js and Rapier overlap on 2D physics. Three.js and OGL overlap on 3D.
GUI-first, not agent-drivable today: OBS Studio (desktop capture app) and OpenCut (its MCP server and headless mode are planned, not shipped). Libraries such as React Spring, p5.js and tsParticles are not GUI-only but animate on the real-time clock, so they need a host that controls time.
Assets tooling: glTF Transform prepares 3D files for Three.js; it is not part of the render loop.
Comments on the post, tested
- Mike W. Otten: most of the 20 are already covered by an existing skill, belong to another skill, or do not suit how Claude builds motion; only HyperFrames and Chatterbox merited work.
- Partly supported. The 20 are of different kinds: two renderers, an encoder, two audio/captions tools that run headless, and a set of in-page libraries that only produce frames inside a renderer that controls time. HyperFrames lists GSAP, Lottie, Three.js and Anime.js as adapters, which supports “belongs to another skill”. OBS Studio and OpenCut are GUI-first, which supports “does not suit an agent”.
- Not supported as stated: faster-whisper and FFmpeg are also headless and needed in a pipeline (HyperFrames itself requires FFmpeg), so the useful subset is wider than two.
- Cristiano Maretti: HyperFrames and Remotion reach the results he tried to get in Rust.
- Consistent. Both are headless Chrome plus FFmpeg renderers. A comparison with Rust renderers is outside this note.
- Cedric Lejeune: the
vfx-file-namingskill as a 21st entry. It is an agent skill rather than a rendering or media tool, so it sits outside this list.
Related
Sources
- LinkedIn post by Arminas Valunas, 2026-10-26:
https://www.linkedin.com/posts/arminas-valunas-b4477255_20-open-source-repos-a-full-motion-studio-ugcPost-7520399088215887873-NjWf/ - The 20 GitHub repositories linked in the table, and the sources listed in each child note.