# Clone the repository
git clone https://github.com/magooney-loon/pb-llm
cd pb-llm
# Run the scraper
go run cmd/main.goPocketBase Documentation Scraper for LLM Usage
=============================================
DESCRIPTION:
Scrapes PocketBase documentation and automatically generates 4 variations:
β’ Full - Complete documentation with all extensions
β’ Go-only - Go extensions only (backend development)
β’ JS-only - JavaScript extensions only (frontend development)
β’ Core-only - Core PocketBase without any extensions
Each variation is generated in ultra-compact LLM-optimized and plain text formats.
USAGE:
go run cmd/main.go [OPTIONS]
OPTIONS:
-help
Show this help message
OUTPUT FORMATS:
β’ .llm.md - Ultra-compact LLM format for maximum token efficiency
β’ .txt - Plain text format for general use
FEATURES:
π€ LLM-optimized output format
π Token counting and estimation
π Context window usage analysis
π§ AI training dataset structure
π Comprehensive LLM usage statistics
π Plain text backup format
π― Automatic generation of all variations
π¦ Pick exactly what you need
OUTPUT (4 variations Γ 2 formats = 8 documentation files):
β’ pocketbase_docs_full.llm.md/.txt - Complete documentation
β’ pocketbase_docs_go.llm.md/.txt - Go extensions only
β’ pocketbase_docs_js.llm.md/.txt - JavaScript extensions only
β’ pocketbase_docs_core.llm.md/.txt - Core PocketBase only
β’ summary_*.txt - Individual statistics for each variation
EXAMPLE:
go run cmd/main.go # Generates all 4 variations
All files saved in timestamped docs/session_YYYY-MM-DD_HH-MM-SS.mmm/ directory