This package has been audited and aligned as a low-weight local creator tool:
- Local-first folder audio visualizer.
- Playable voxel directory for detected audio files.
- Image binding per track.
- Artist-required export metadata with 36-character cap.
- Live export preview.
- Browser Record for quick previews.
- Session Export Vault with edit/re-export.
- Deterministic FFmpeg MP4 Kit for production output.
- Album Route Builder for multi-track render kits.
- Lite / Eco / Auto / High performance ladder for older hardware.
- Reset/Back button bindings corrected in v1.7.1 after audit.
- Production hardening in v1.8.16: Lite mode, cached background render, hidden-tab pause, web-node draw caps, throttled artwork transforms, debounced resize, and automatic performance governor.
The no-server build is usable now. Google OAuth, Stripe, account quotas, and server FFmpeg rendering are roadmap systems, not active local-build features yet.
See:
docs/EXTENSIVE_AUDIT_REPORT.mddocs/PERFORMANCE_TUNING.mddocs/SONG_TITLE_AUTHORITY.mddocs/RELEASE_STATUS.mddocs/OPERATOR_MANUAL.md
Voxel Audio is a local-first, browser-based audio visualizer and export tool that turns a folder of songs into a playable voxel directory, binds artwork to tracks, previews SoundCloud-style export layouts live, and builds deterministic FFmpeg MP4 render kits for single tracks or full albums.
Local audio folder → playable voxel grid → image-bound visualizer → preview → MP4 kit
Features · Quick Start · Export Workflows · Album Route Builder · Docs Routing · Roadmap
Voxel Audio is built as a creator-facing audio export platform using the design language of Proto-Synth Grid Engine.
Reference:
https://github.com/GareBear99/Proto-Synth_Grid_Engine
Proto-Synth Grid Engine is a deterministic, math-first, low-weight 2D simulation projected to feel visually 3D. Voxel Audio adapts that doctrine into an audio product:
- folders become route surfaces
- tracks become playable voxels
- RGB color becomes export identity
- album routes become renderable structures
- Canvas2D keeps the platform no-server and lightweight
- FFmpeg kits provide deterministic release output
Most quick music visualizer workflows are either locked behind cloud upload tools, fragile browser screen-recording, or heavyweight video editors. Voxel Audio is designed to be:
- Local-first — your audio and images stay on your machine.
- Folder-native — drag in a folder and every valid audio file becomes a playable voxel.
- Release-aware — preview visually in-browser, but generate final MP4 through deterministic FFmpeg scripts.
- Album-capable — build a route from selected tracks, current folder, search results, or all loaded songs.
- Artist-friendly — bind cover art, rename export titles, control colors, and produce SoundCloud-style video assets.
The browser Record renderer includes a free-tier watermark scaffold.
Planned USD tiers:
- Free — watermarked browser Record exports, 5 exports/week.
- $3 USD/month — 99 server FFmpeg exports/month.
- $7 USD/month — unlimited no-watermark browser Record exports and unlimited no-watermark server FFmpeg exports.
Voxel Audio is being positioned with a creator-friendly USD export model once accounts and server rendering are connected.
$0 USD
The free account plan is intended for:
- browser Record exports
- watermarked exports
- 5 exports/week once Google OAuth accounts are released
- local folder playback
- voxel directory browsing
- image binding
- live export preview
$3 USD/month
Planned benefits:
- 99 server FFmpeg exports/month
- server-side FFmpeg MP4 rendering
- Google OAuth account login
- Stripe subscription integration
- better reliability than browser recording for creators who need rendered MP4 output
$7 USD/month
Planned benefits:
- unlimited no-watermark browser Record exports
- unlimited no-watermark server FFmpeg exports
- best fit for creators releasing polished visualizers regularly
- removes the weekly/monthly export ceiling
The account/server plan requires:
- Google OAuth login
- Stripe subscription checkout and billing
- account export counters
- free weekly export limits
- monthly paid FFmpeg export quotas for the $3 USD tier
- unlimited entitlement checks for the $7 USD tier
- server-side FFmpeg render queue
- watermark policy for free browser Record exports
- no-watermark policy for paid tiers
- Open a folder with the picker.
- Drag/drop a folder anywhere on the screen.
- Detects playable audio files:
mp3wavoggm4aaacflacopuswebm
- Preserves nested route paths for search and album building.
- Every valid audio file becomes:
- a voxel in the scene
- a row in the Browser Hub
- an exportable audio source
- Click a voxel to play its track.
- Voxel color is seeded and track-specific.
- Selected track color syncs with:
- app border accent
- waveform accent
- export preview accent
- browser record accent
- FFmpeg render kit accent
- album segment accent
- Search filters valid track rows and voxels.
- Browser Hub is height-matched to the left panel.
- Browser Hub scrolls internally.
- Recenter button restores the voxel scene if the view is moved offscreen.
- Bind artwork to the selected track.
- Drag/drop an image onto a voxel to bind directly.
- Bound image is used by:
- live floating image preview
- Live Export Preview
- Browser Record Export
- single-track FFmpeg MP4 kit
- album route export kit
- Opens a scaled 1280×720 preview panel.
- Uses the same visual renderer as browser recording.
- Updates while audio plays.
- Uses the selected song’s voxel RGB color.
- Uses editable Song name.
- Shows the final single-track visualizer composition before export.
Browser Record is included as a convenience preview/export path.
10s Recordrecords a short normal-speed preview.Record Fullrecords the full track at normal 1x speed.Record: Auto / MP4 / WebMlets the browser pick supported output.- Run log explains failures when browser recording APIs are unsupported.
Browser recording is useful, but final release output should use the deterministic FFmpeg kit.
The production path is not browser self-recording.
Build MP4 Kit downloads:
- the selected audio source
- the bound cover image
render_manifest.jsonrender_ffmpeg.shrender_ffmpeg.bat- run log
Run the script and FFmpeg renders a real H.264/AAC MP4.
Album Route Builder can collect songs from anywhere in the loaded folder tree:
- selected track
- visible/search results
- current folder
- all loaded tracks
It then generates a full album render kit:
- all routed audio files
- per-track covers or fallback cover
album_manifest.jsonrender_album_ffmpeg.shrender_album_ffmpeg.bat- album run log
Each track segment can use:
- its original voxel RGB color
- a per-track custom album color
- one album-wide color applied to every track
Voxel Audio is built to work as a no-server local app.
You can use it by simply double-clicking:
index.html
No backend is required.
No account is required.
No upload is required.
No local Node server is required for normal use.
A local static server is optional only when you want more predictable browser behavior during development.
- Folder picker.
- Drag/drop folder loading.
- Audio playback.
- Voxel scene rendering.
- Search.
- Image binding.
- Live Export Preview.
- Browser Record Export.
- FFmpeg MP4 Kit generation.
- Album Route Builder.
- Info/docs overlay.
Voxel Audio includes a no-server browser recording feature:
- 10s Record records a short normal-speed preview.
- Record Full records the selected song at normal 1x playback speed.
- Record: Auto / MP4 / WebM selects the browser recording preference.
- Download Run Log explains any recording failure.
Browser Record is best for quick previews. For release-grade MP4 output, use Build MP4 Kit.
The app includes a fixed upper-right Quick Dock so critical controls remain accessible even if the top bar overflows on smaller screens.
Quick Dock buttons:
+ Folder+ Imageⓘ InfoPreviewRecordMP4 KitAlbum
A small startup diagnostic appears briefly on load and reports if required browser APIs or controls are missing.
The app now keeps duplicated Quick Dock actions out of the top scroll bar, making the top bar shorter and easier to use.
Critical actions stay in the fixed Quick Dock:
- Folder
- Image
- Info
- Preview
- Record
- MP4 Kit
- Album
- Bindings
Runtime error diagnostics now appear onscreen if a control or browser API fails instead of silently freezing.
Double-click index.html or open it directly in a modern browser. This is the recommended no-server path.
Recommended browsers:
- Chrome
- Edge
- Safari for MP4 experiments
- Any browser with Web Audio and Canvas support for playback/visuals
Some browser features behave better from a local server.
python3 -m http.server 8080Then open:
http://localhost:8080
- Click Open Audio Folder, or drag/drop a folder anywhere.
- Click a voxel or Browser Hub row to select/play a song.
- Click Bind Image To Selected, or drag an image onto a voxel.
- Edit Song name in the export panel if needed.
- Click Preview Export.
- Use 10s Record for a quick browser preview.
- Use Build MP4 Kit for final release-quality MP4 output.
Voxel Audio now supports binding-map metadata:
- Export Bindings downloads a JSON map of track/image/color binding metadata.
- Import Bindings matches loaded tracks by path/name and restores metadata.
- Image blobs may still need rebinding because browsers do not allow silent restoration of arbitrary local files.
Browser Record exports are now protected by a session vault.
After 10s Record or Record Full completes, Voxel Audio keeps the last 9 browser Record exports in memory with Download buttons.
This solves the problem where a browser download prompt is missed or dismissed at the end of the recording stream.
Important notes:
- The vault is session-only.
- It clears when the page is closed or reloaded.
- It does not upload anything.
- It is for Browser Record outputs, not FFmpeg kit files.
Voxel Audio now blocks visual export actions unless artwork is bound to the selected track.
Required before single-track export:
- Select/play a song.
- Bind or drop an image onto that song.
- Confirm the floating image appears.
- Then use Preview, Record, or Build MP4 Kit.
Blocked until artwork is present:
- Preview Export
- 10s Record
- Record Full
- Build MP4 Kit
Album export also requires artwork coverage: either every routed track has artwork, or a fallback album cover is set.
The renderer clamps rounded-rectangle radius values so tiny progress bars and UI pills cannot explode into giant foreground shapes. This prevents the waveform/progress accent color from covering the cover image or export layout.
The export renderer now disables large RGB blob/triangle accent fills. Only subtle background glow is allowed.
This guarantees the cover image, title, description panel, waveform panel, and watermark are never covered by foreground color geometry.
All export visual elements now follow the selected song's voxel RGB color:
- title glow
- metadata text
- description/capsule panel
- cover outline
- reactive circle
- waveform
- progress bar
- watermark
- preview/export panel borders
- background glow
Voxel Audio export layouts now include editable metadata:
- Song name
- Artist
- Feat
- Description
The Description field defaults to:
full-track reactive visualizer
The export renderer uses a strict layer policy so RGB accent shapes stay behind the cover image, description panel, title, and waveform panel.
The circular visual element is now a real reactive frequency visualizer using bass, mid, treble, and frequency-spoke motion.
Use this for actual music distribution, store previews, YouTube uploads, SoundCloud visual assets, or release promos.
- Select a song.
- Bind artwork.
- Click Preflight.
- Click Build MP4 Kit.
- Move all downloaded kit files into one folder if your browser separates downloads.
- Run:
macOS/Linux:
chmod +x render_ffmpeg.sh
./render_ffmpeg.shWindows:
render_ffmpeg.batOutput:
<song>_Voxel_Audio.mp4
Use this for quick checks.
- Select a song.
- Bind artwork.
- Click Preview Export.
- Click 10s Record.
- Review the downloaded preview.
Browser recording is normal 1x song speed. It is intentionally not accelerated.
brew install ffmpegwinget install Gyan.FFmpegsudo apt install ffmpegOpen Album Route.
Add tracks by:
- Add Selected — adds the current song.
- Add Visible/Search — adds whatever the current search/filter shows.
- Add Current Folder — adds tracks from the selected/current folder.
- Add All Loaded — adds every loaded track.
Then configure:
- Album title
- Route name
- Fallback cover image
- Per-track colors
- Album-wide color
Click Build Full Album Kit.
Run:
chmod +x render_album_ffmpeg.sh
./render_album_ffmpeg.shor on Windows:
render_album_ffmpeg.batThe script renders each track segment and concatenates the full album MP4.
The app includes an in-app ⓘ Info overlay with route-based documentation:
- Overview
- Quick Start
- Controls
- Folder Loading
- Search
- Image Binding
- Live Preview
- Browser Record
- MP4 Kit
- Layout / Panels
- Troubleshooting
- Album Route Plan
- Release Notes
External docs mirror the same structure in docs/routes.
Voxel Audio is local-first.
- No uploads.
- No external API required.
- Audio files stay on your machine.
- Images stay on your machine.
- Export kits are generated locally in the browser.
- Final MP4 rendering happens locally through FFmpeg.
Playback and visualizer features use:
- HTML File APIs
- Canvas 2D
- Web Audio API
- drag/drop APIs
Browser Record uses:
MediaRecordercanvas.captureStream- WebAudio stream routing
These APIs vary by browser. When browser recording fails, use the deterministic FFmpeg kit.
voxel-audio/
├── index.html
├── README.md
├── LICENSE
├── CHANGELOG.md
├── package.json
├── docs/
│ ├── routes/
│ ├── EXPORT_WORKFLOWS.md
│ ├── ALBUM_ROUTE_BUILDER.md
│ ├── TROUBLESHOOTING.md
│ └── ARCHITECTURE.md
├── examples/
│ └── example-render-manifest.json
├── scripts/
│ └── package_release.py
└── .github/
├── ISSUE_TEMPLATE/
└── workflows/
- Native desktop wrapper for automatic FFmpeg rendering.
- One-click final MP4 export without manual script execution.
- Persisted image binding maps.
- Saved export presets.
- Album route import/export JSON.
- Drag reorder album route tracks.
- Optional waveform style presets.
- GitHub Pages demo shell.
- Optional WebCodecs/WebGPU renderer path.
Voxel Audio targets:
- local audio visualizer
- SoundCloud style visualizer
- MP4 music visualizer generator
- FFmpeg audio visualizer
- browser music visualizer
- album visualizer export
- local-first music video generator
- canvas audio waveform visualizer
- Web Audio visualizer
- artist release video tool
MIT License. See LICENSE.
When the Description field is left blank, Voxel Audio now uses a tighter export layout instead of leaving empty text space.
- Blank Description = compact visualizer capsule.
- Typed Description = full description panel.
- Reactive circle stays active in both modes.
The export Description field is optional. If left blank, no description is rendered.
The export layout now prevents collisions between:
- watermark and waveform/timestamps
- metadata row and reactive circle
- description/capsule text and circle lane
Long metadata text is automatically ellipsized to stay inside the safe lane.
The export panel includes Admin name and Admin key inputs.
Local dev/admin key:
VOXEL-AUDIO-ADMIN
Entering the key disables the free watermark for browser Record exports in the current local browser/session. This is a development scaffold only; production no-watermark access must be enforced server-side through Google OAuth, Stripe, and render entitlement checks.
When the free watermark is active, exports display:
TIZWILDIN ENTERTAINMENT
A TizWildin Entertainment Product
The Admin key can still disable the watermark locally for development/testing.
The export panel now includes:
- Admin name
- Admin key
- admin clean-export status hint
- single Export color chooser
The admin unlock removes the watermark from Live Preview and Browser Record immediately.
The Export color picker defaults to the selected voxel color, but can be changed for that single audio export.
Completed 10s Record and Record Full exports appear in the Session Export Vault.
Use the Quick Dock:
Vault
The Vault also opens automatically after a successful browser Record export. It keeps the last 9 completed browser Record exports from the current session, each with a Download button.
Completed browser Record exports in the Session Export Vault can now be edited and re-exported.
Editable per vault item:
- Song name
- Artist
- Feat
- Description
- Export color
Click Re-export to re-run the same Record mode using the edited metadata. The original track and image binding must still be loaded in the current session.
Voxel Audio now requires an Artist name before Preview, Record, or MP4 Kit export.
Rules:
- Artist is required.
- Artist max length is 36 characters.
- Artist is locked into export metadata when recording/export starts.
- Vault re-export also requires Artist.
Selecting a voxel now always resets the export color to that voxel's RGB color.
Manual color override still works, but only until you select another voxel.
Clicking/playing a real audio voxel now immediately pushes that voxel color into the Export color input and export renderer.
The issue was that the real audio-file branch played the track but skipped the color-sync call.
- Reset fully returns the app to startup state and clears the loaded session.
- Back only backs out of panels, folder focus, search, selected voxel focus, or zoom. It does not delete the loaded folder/session.
For the current audited and production-hardened package state, use these docs first:
| Document | Purpose |
|---|---|
docs/EXTENSIVE_AUDIT_REPORT.md |
Full package audit, confirmed capabilities, known constraints, and next engineering pass. |
docs/PERFORMANCE_TUNING.md |
docs/SONG_TITLE_AUTHORITY.md| Weak-hardware Lite/Eco operating guide and performance governor notes. | |docs/RELEASE_STATUS.md| What is ready now vs. what is still roadmap. | |docs/OPERATOR_MANUAL.md| Straight usage manual for loading, binding, previewing, recording, vault, and FFmpeg kit workflow. | |docs/ARCHITECTURE.md| Runtime layer map and quality ladder. | |docs/PRODUCTION_HARDENING_PASS.md| v1.8.16 runtime hardening details and remaining SaaS blockers. | |docs/RESET_AND_BACK_BEHAVIOR.md| Correct Reset/Back behavior after v1.7.1 binding fix. |
The v1.8.2/v1.8.3 title marquee experiment has been reverted. Export title rendering is restored to v1.8.1 behavior while keeping Song Title Authority intact. See docs/TITLE_RENDER_REVERT.md.
The small VOXEL AUDIO EXPORT • song • artist/feat export metadata line now scrolls inside a clipped safe lane and cannot overlap the reactive circle. Main title rendering is untouched. See docs/SIDE_METADATA_SCROLL_FIX.md.
Live Export Preview now correctly shows the small metadata line scrolling because the preview renderer uses a persistent timing clock instead of resetting every frame. Main title rendering is untouched. See docs/PREVIEW_SCROLL_CLOCK_FIX.md.
The small side metadata scroll now holds longer at the end before resetting back to the start. Main title rendering remains untouched. See docs/SIDE_METADATA_END_PAUSE.md.
Browser Record MP4 is restored and now tries direct <audio>.captureStream() before WebAudio capture to reduce silent MP4 exports. The recorder logs audio/video track counts before recording starts. See docs/MP4_DIRECT_AUDIO_RESTORE.md.