MidiPilot - Your AI Copilot

MidiPilot is the AI brain embedded directly in MidiEditor AI. Open the sidebar panel, type what you want in plain English, and watch it compose, edit, transform, and analyze your MIDI data automatically.

Key Features

Getting Started

1. Open Settings (gear icon or Edit → Settings) and click the MidiPilot AI tab
2. Select your Provider (Google Gemini is a great free option)
3. Enter your API Key (get one from OpenAI, OpenRouter, or Google Gemini)
4. Choose a Model (e.g., gemini-2.5-flash)
5. Click Test Connection to verify everything works
6. Close settings and open the MidiPilot panel from the sidebar
7. Type a prompt and press Enter:

"Create an 8-bar jazz waltz in Bb major with piano, bass, and drums"

The AI will compose the requested music directly into the editor using its built-in tools. In Agent mode, it works iteratively - creating tracks, setting tempo, inserting notes, and validating the result step by step.

See Prompt Examples for more real-world prompts and a full demo.

Chat Panel

The MidiPilot panel features a clean chat interface with context-aware track info, mode selection (Agent / Simple), and model switching - all accessible without leaving the editor. Assistant bubbles and the live reasoning stream render Markdown (bold, italic, lists, fenced code, links); user and system bubbles stay plain text.

The input bar at the bottom provides quick access to everything you need:

Agent/Simple mode toggle · FFXIV checkbox · Model selector · Reasoning level

• Attach (📎) - Add pictures, PDFs, text files or other files to your message - see Attachments
• Mode selector - Switch between Agent (multi-step) and Simple (single response)
• New Chat - Start a fresh conversation (previous one is auto-saved to history)
• History - Browse and resume past conversations
• FFXIV checkbox - Enable FFXIV Bard Performance constraints
• Model dropdown - Switch models on the fly without opening settings
• Reasoning level - Adjust thinking effort (when supported by the model)
• Token counter - Shows session usage vs. context window size
• Send / Stop - Send your prompt or cancel an in-progress Agent run
• Settings gear - Opens MidiPilot Settings… (the Settings dialog, already on its MidiPilot AI page), Prompt Profiles…, and Save AI preset for this file…
• Status indicator - Shows Ready, Thinking, or error states in real time

Attachments

You can send files along with a message - for example a photo or a PDF of sheet music with “write this melody into track 1”, a screenshot of a score, or a text file with lyrics or ABC notation. Attachments work in Agent and Simple mode.

• Adding files - click the paperclip (📎) in the input bar, drop files anywhere on the MidiPilot panel, or paste with Ctrl+V: a screenshot on the clipboard becomes a picture attachment, copied files are attached as files, and copied text is pasted as text.
• Chips - every attached file appears as a chip above the input with a thumbnail or an icon and its name; the ✕ on a chip removes it. Next to the chips, an estimate shows roughly how many tokens the attachments add. The chips are sent with your next message, and the message bubble lists the file names.
• Pictures (PNG, JPEG, GIF, WebP) are sent as images; other picture formats such as BMP are converted to PNG first. PDFs and other files are sent as files. Text files (.txt, .md, .csv, .json, .xml, .musicxml, .abc, .mml, .lrc, .srt, .log) are put into the message as text, so every model can read them.
• Which model - most current models read pictures and PDFs. Whether a file can be read is decided by the model you picked; when it cannot, the provider's answer appears in the chat. The pictures and files of a message the provider refused are then taken out of the conversation, so your next message goes through; attach them again for a model that reads them.
• Limits - up to 10 MB per file, 14 MB and 10 files per message, and 512 KB for a text file.
• Cost - a conversation is sent in full with every request, attachments included. In Agent mode that means once per step, so a large PDF in an early message counts again at every step; the token counter shows what the provider reported.
• History - attachments are saved with the conversation, in a folder of their own next to it, so a conversation you reopen from the history still has them for follow-up questions. Deleting a conversation deletes its attachments too.

Mode Comparison

Where to go next

The rest of MidiPilot is split across four pages. Each box names the page and lists the sections on it - the section links take you straight to the right spot.