Browser LLM Demo Working with JavaScript and WebGPU

WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26), and Android (check)

Demo, similar to ChatGPT: https://andreinwald.github.io/browser-llm/

No need to use your OPENAI_API_KEY - it's a local model that runs on your device
No network requests to any API
No need to install any program
No need to download files to your device (model is cached in browser via CacheStorage)
Site will ask before downloading large files (LLM model) to browser cache
Hosted on GitHub Pages from this repo - secure, because you can see what you're running
Default model: Llama-3.2-1B

WebGPU Browser and OS Compatibility

Name		Name	Last commit message	Last commit date
Latest commit History 47 Commits
docs		docs
src		src
.gitignore		.gitignore
README.md		README.md
index.html		index.html
package.json		package.json
screenshot.png		screenshot.png
tsconfig.json		tsconfig.json
vite.config.ts		vite.config.ts