FFmpeg
A collection of libraries and command-line tools to process audio, video, subtitles and metadata. Part of Open-source motion studio: 20 repos.
Checked 2026-10-27 against the GitHub repository, its README, and the npm or PyPI registry where relevant.
| Runtime | Native binary on every desktop OS; CPU, with optional hardware acceleration. Fully headless. |
| How an agent drives it | Command line, scriptable and deterministic for a given input and settings. Every serious video pipeline in this list already calls it, including [[../libraries/hyperframes |
| License | Mostly LGPL-2.1-or-later; some optional parts are GPL-2.0-or-later and switch the build to GPL when enabled with --enable-gpl (LICENSE.md). Patent and codec licensing is a separate question for each codec. |
| Maintenance | Active: repo pushed 2026-10-27; the repo has 9.x release tags (n9.0.2 seen). Not archived. |
What it gives you
- Libraries: libavcodec (codecs), libavformat (containers and protocols), libavfilter (filter graphs), libavdevice (capture devices), libswresample and libswscale.
- Tools:
ffmpeg(convert, mix, filter, stream),ffplayandffprobe(inspect).
Key differentiator
Covers essentially every codec, container and filter in one tool; the universal last step of a video pipeline. Source: README.
Pick something else when
HandBrake for a GUI transcoder. GStreamer for a pipeline framework embedded in an application (LGPL). A renderer’s own encoder settings when you are already inside Remotion or HyperFrames.
Agent fit
Strong. Non-interactive, widely documented and understood by coding agents. The one required piece in the list.
Overlap within the 20
Used inside HyperFrames and Remotion; bundled into faster-whisper’s decoder through PyAV; overlaps OBS Studio on recording and encoding.