MP4 TO MIDI · MEASURED EXTRACT TEST · UPDATED 2026-10-24
MP4 to MIDI Converter: Turn Video Audio Into MIDI Notes
To convert MP4 to MIDI, extract the audio track from the video, then run note detection on that audio — the same path as WAV or MP3. On this site: open the free converter, choose your .mp4 or .mov (up to 50 MB and 3 minutes), keep the tab open, and download the .mid. Demux uses FFmpeg -vn in your browser; nothing is uploaded. We do not claim 100% accurate transcription.
Open the free MP4 to MIDI converter
How to convert MP4 to MIDI (step by step)
- Open the converter. No install and no account. The same homepage tool accepts MP4 and MOV.
- Choose one .mp4 or .mov under 50 MB with an audible audio track. Screen recordings with no sound will fail (see troubleshooting below).
- Convert and keep the tab open. Status moves through reading, decoding (demux + resample) and detecting notes. Cancel is available if you need to stop.
- Download the .mid and edit it in a DAW. Expect to fix notes; automatic transcription is not perfect.
What MP4 to MIDI actually does in our converter (measured 2026-10-24)
MP4 to MIDI on this site is not a separate “video model.” It is audio-track extract, then the same Basic Pitch path used for WAV and MP3. We built six sample files from one four-note melody (C4, E4, G4, C5), ran the same FFmpeg arguments the site’s app.js uses (-t 180.1 -vn -ac 1 -ar 22050 -f f32le), and recorded size, wall time and RMS. Browser wall time will differ; the args and PCM shape match.
| Sample | Container / codecs | File size | Extract time | PCM bytes | PCM duration | RMS | Result |
|---|---|---|---|---|---|---|---|
| melody-h264-aac.mp4 | MP4 · H.264 + AAC | 59,868 B | 0.070 s | 354,304 | 4.017 s | 0.174 | Ready for note detection |
| melody-mp3-in-mp4.mp4 | MP4 · MP3 audio only | 33,765 B | 0.063 s | 354,912 | 4.024 s | 0.165 | Ready for note detection |
| melody.m4a | M4A · AAC, no video | 52,870 B | 0.069 s | 354,304 | 4.017 s | 0.174 | Same AAC PCM shape as the H.264+AAC file |
| source-melody.wav | WAV · PCM | 352,844 B | 0.103 s | 352,800 | 4.000 s | 0.175 | Baseline; live site returned 4 MIDI notes on 2026-09-30 |
| video-only-no-audio.mp4 | MP4 · H.264, no audio | 5,043 B | 0.059 s | 0 | 0 | — | ffmpeg exit 234: no stream to write |
| video-with-silent-aac.mp4 | MP4 · H.264 + silent AAC | 9,213 B | 0.067 s | 354,304 | 4.017 s | 0.000 | Decode OK; silent gate rejects (RMS < ~1e-5) |
Download the extracted mono WAVs we wrote from the two successful MP4s: from H.264+AAC · from MP3-in-MP4. The known MIDI from converting the same source melody as WAV on the live site is same-melody-wav-result.mid (4 notes, 72 bytes). Full machine-readable log: results.json.
Honest limit: this test measures demux and silence gates. It does not invent an “MP4 accuracy %.” After a successful extract, note quality follows the same Basic Pitch limits as any other format on this site.
Container vs codec: what “MP4” means for this tool
An .mp4 extension names a container, not a guarantee of AAC audio. Competitors’ “MP4 to MIDI” labels often stop at the extension. We accept the file when the extension is in the allow-list (mp4, mov), then the decoder must find a usable audio stream.
| File | Looks like | Actual streams (ffprobe) | Our converter | Common competitor claim |
|---|---|---|---|---|
| melody-h264-aac.mp4 | Video file | H.264 video + AAC audio @ 44.1 kHz | Accepted; -vn keeps AAC → PCM | “MP4 supported” — usually this case |
| melody-mp3-in-mp4.mp4 | .mp4 name | MP3 audio only, no video | Accepted (extension allow-list); demux works | Often still marketed as MP4 even when only audio is MP3 |
| melody.m4a | Audio file | AAC only (same family as MP4) | Accepted as M4A/AAC | Usually listed separately from “MP4” |
On our samples the H.264+AAC MP4 and the M4A produced identical PCM byte counts (354,304) and the same RMS (0.174) after extract. The MP3-in-MP4 file was slightly longer (4.024 s vs 4.017 s) and a lower RMS (0.165), matching MP3 encoding loss on the same melody. The converter does not care about the video picture; pixels are discarded.
MP4 to MIDI troubleshooting (cases the SERP tools do not spell out)
Most “MP4 to MIDI” pages on the 2026-10-24 Google US top 10 advertise a converter and skip failure modes. These three cases are what we actually hit with files we built today:
- No audio stream (silent video track / video-only export). Screen recordings and some phone exports can be video-only. Our 5,043-byte sample has H.264 and no audio. Extract wrote 0 bytes and ffmpeg exited 234 with “Output file does not contain any stream.” On the site that surfaces as a decode error — not an empty MIDI.
- Silent AAC track. The container looks fine: video + AAC. Our silent-AAC sample demuxed to 354,304 bytes of zeros (RMS 0.000). The converter’s silent gate (RMS below about 1×10⁻⁵) rejects it before Basic Pitch runs, with the message that the recording is silent or too quiet.
- DRM / encrypted audio. Streams wrapped for FairPlay, Widevine or similar will not decode in the in-browser FFmpeg build. There is no workaround on this page; export an unprotected audio stem (WAV/MP3/M4A) from a tool that is licensed to play the file, then convert that stem.
Also check the shared limits: one file, ≤50 MB, ≤3 minutes after decode. Variable frame rate on the video track did not block audio extract in a quick check (same -vn path); if demux fails, re-export audio-only from your editor.
Assumptions and method
- Input: one local file; extensions include
mp4andmov. - Demux: FFmpeg in WebAssembly with
-vn(drop video), mono, 22,050 Hz, float32 PCM, hard stop near 180 seconds. - Notes: Spotify Basic Pitch in a worker; one instrument track; MIDI tempo written at 120 BPM for tick layout.
- Privacy: conversion stays on device; see the no-upload proof and privacy policy.
When not to use this for MP4
- You need the picture or the original soundtrack preserved — MIDI cannot do that.
- You need separate instrument stems from a full song video — this writes one track of pitched notes.
- The file is DRM-protected or has no usable audio stream.
- You need drum-map MIDI from a drum video — use drum to MIDI on an isolated drum stem instead.
Questions
How do I convert MP4 to MIDI?
Open the free converter on this site, choose your .mp4 (or .mov) file, and convert. The tool extracts the audio track in your browser (FFmpeg -vn), resamples it to 22,050 Hz mono, runs Spotify Basic Pitch for notes, and offers a .mid download. Files up to 50 MB and 3 minutes. Nothing is uploaded.
Does this site accept MP4 video files?
Yes. The homepage file picker accepts .mp4 and .mov as well as MP3, WAV, OGG, M4A, AAC, FLAC and WMA. For video containers the decoder strips video and keeps audio.
Is MP4 to MIDI the same as converting an MP3?
After the audio is extracted, yes: the same Basic Pitch model, the same 22,050 Hz mono input, and the same one-track MIDI writer. The only MP4-specific step is demuxing the audio stream. Our 2026-10-24 extract test on a 4-second H.264+AAC MP4 finished demux in 0.070 s on the box and produced 354,304 bytes of PCM.
What if my MP4 has no sound?
Two different failures. A file with only a video stream (no audio track) cannot be demuxed to PCM — our video-only sample returned ffmpeg exit 234 and 0 bytes. A file with a silent AAC track demuxes fine but RMS is 0, so the converter rejects it as silent before note detection. Neither invents MIDI.
Can I convert a DRM-protected movie to MIDI?
No. Encrypted or DRM-protected streams (for example FairPlay or Widevine) are not decoded by the in-browser FFmpeg build. The UI reports a decode error instead of inventing notes.
Does the MIDI include the video picture?
No. MIDI stores note events, not pixels or the original soundtrack. The video frames are discarded with -vn. What you download is pitches and timings from the audio track only.
Is my MP4 uploaded?
No. Demux, resample and note detection run in your browser tab. The site only delivers the converter, model and decoder files. You can confirm in DevTools Network that no POST sends your file.
Will the MIDI be 100% accurate?
No. Automatic transcription is not note-perfect. Plan to edit. We do not publish an invented accuracy percentage for MP4 wrappers; after extract the result depends on the same model limits as WAV or MP3.
Related reading
Published 2026-10-24. Extract sizes and timings are from files we generated and measured the same day; raw numbers are in results.json.