Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

LeslieLeung/glean

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Glean 拾灡

English | δΈ­ζ–‡

Important

Join our Discord to stay updated on the latest developments and get support.

This project is still in development and is not ready for production use.

A self-hosted RSS reader and personal knowledge management tool.

Glean (拾灡) helps information-heavy consumers efficiently manage their reading through intelligent RSS aggregation.

Glean

Features

Core Features

  • πŸ“° RSS Subscription - Subscribe and organize RSS/Atom feeds with OPML import/export
  • πŸ“š Smart Reading - Clean reading experience with content filtering
  • πŸ”– Read Later - Save articles for later reading with auto-cleanup
  • πŸ“ Folders & Tags - Multi-level folders and tags for organization
  • ⭐ Bookmarks - Save articles from feeds or external URLs
  • πŸ”§ Background Sync - Automatic feed updates every 15 minutes
  • πŸ”’ Self-hosted - Full data ownership with Docker deployment
  • 🎨 Modern UI - Beautiful, responsive warm dark theme interface
  • πŸ‘¨β€πŸ’Ό Admin Dashboard - User management and system monitoring

Planned Features (WIP)

  • 🧠 Smart Recommendations - AI-powered preference learning and article scoring
  • βš™οΈ Rule Engine - Automated processing with Jinja2-style conditions
  • πŸ€– AI Features - Summary generation, auto-tagging, keyword extraction (BYOK)
  • πŸ“„ Full Content Fetch - Fetch complete article content for RSS summaries
  • πŸ”Œ Chrome Extension - One-click bookmarking from browser
  • πŸ“± Mobile PWA - Progressive Web App for mobile devices

Quick Start

One-Command Deployment

# Download docker-compose.yml
curl -fsSL https://raw.githubusercontent.com/LeslieLeung/glean/main/docker-compose.yml -o docker-compose.yml

# Start Glean (full deployment with Milvus)
docker compose up -d

# Access:
# - Web App: http://localhost
# - Admin Dashboard: http://localhost:3001

Lite Deployment (without Milvus, if you don't need Phase 3 features):

# Download lite version
curl -fsSL https://raw.githubusercontent.com/LeslieLeung/glean/main/docker-compose.lite.yml -o docker-compose.yml

# Start Glean
docker compose up -d

Create Admin Account

After first startup, create an admin account to access the dashboard:

# Generate random password (recommended)
docker exec -it glean-backend /app/scripts/create-admin-docker.sh

# Or specify custom credentials
docker exec -it glean-backend /app/scripts/create-admin-docker.sh myusername MySecurePass123!

Alternatively, create admin on first startup using environment variables:

# Set admin credentials in .env
CREATE_ADMIN=true
ADMIN_USERNAME=admin
ADMIN_PASSWORD=YourSecurePassword123!

# Start services
docker compose up -d

# Check logs to confirm
docker compose logs backend | grep "Admin Account Created"

Configuration

For production, customize your deployment with environment variables. Download the example file:

curl -fsSL https://raw.githubusercontent.com/LeslieLeung/glean/main/.env.example -o .env

Important settings to change:

Variable Description Default
SECRET_KEY JWT signing key Must change in production!
POSTGRES_PASSWORD Database password glean (Change in production!)
WEB_PORT Web interface port 80
ADMIN_PORT Admin dashboard port 3001
CREATE_ADMIN Auto-create admin false (set true for first start)

For all configuration options, see .env.example.

Docker Images

Pre-built images are available on GitHub Container Registry:

  • ghcr.io/leslieleung/glean-backend:latest - API server & worker
  • ghcr.io/leslieleung/glean-web:latest - Web frontend
  • ghcr.io/leslieleung/glean-admin:latest - Admin dashboard

Supported architectures: linux/amd64, linux/arm64

Testing Pre-release Versions

Want to test upcoming features? Use pre-release versions (alpha/beta/rc):

Method 1: Using environment variable (recommended)

# Set the IMAGE_TAG in .env file
echo "IMAGE_TAG=v0.3.0-alpha.1" >> .env

# Or export it directly
export IMAGE_TAG=v0.3.0-alpha.1

# Start with pre-release images
docker compose up -d

Method 2: Inline environment variable

IMAGE_TAG=v0.3.0-alpha.1 docker compose up -d

Note: Pre-release versions are for testing only. They won't trigger auto-updates for Electron apps and are not recommended for production use.

See available pre-release versions on the Releases page.

Deployment

The default deployment includes all services (full version):

  • Web App (port 80) - Main user interface
  • Admin Dashboard (port 3001) - User management and system monitoring
  • Backend API - FastAPI server
  • Worker - Background task processor (feed fetching, cleanup)
  • PostgreSQL - Database
  • Redis - Task queue
  • Milvus - Vector database for smart recommendations and preference learning (Phase 3)

Lite deployment (without Milvus) is also available using docker-compose.lite.yml.

For detailed deployment instructions and configuration, see DEPLOY.md.

Tech Stack

Backend:

  • Python 3.11+ / FastAPI / SQLAlchemy 2.0
  • PostgreSQL / Redis / arq (task queue)

Frontend:

  • React 18 / TypeScript / Vite
  • Tailwind CSS / Zustand / TanStack Query

Development

See DEVELOPMENT.md for complete development setup instructions.

Quick start:

# Clone and setup
git clone https://github.com/LeslieLeung/glean.git
cd glean
npm install

# Start infrastructure
make up

# Initialize database (first time only)
make db-upgrade

# Install pre-commit hooks (optional but recommended)
make pre-commit-install

# Start all services
make dev-all

# Access:
# - Web: http://localhost:3000
# - Admin: http://localhost:3001
# - API Docs: http://localhost:8000/api/docs

Pre-commit Hooks

The project uses pre-commit hooks to ensure code quality:

# Install hooks (one-time setup)
make pre-commit-install

# Run hooks manually on all files
make pre-commit-run

# Uninstall hooks (if needed)
make pre-commit-uninstall

Hooks automatically run on commit and check:

  • Backend: ruff format, ruff linter, pyright type checking
  • Frontend: ESLint, Prettier formatting
  • General: trailing whitespace, file endings, YAML/JSON/TOML validation

Roadmap

Phase Status Features
Phase 1: MVP βœ… Done User system, RSS subscription, reader, admin dashboard
Phase 2: Organization βœ… Done Bookmarks, folders, tags, read later
Phase 3: Preferences 🚧 WIP Embedding pipeline, preference learning, smart recommendations
Phase 4: Rules πŸ“‹ Planned Rule engine, Jinja2 conditions, automated actions
Phase 5: AI πŸ“‹ Planned AI summaries, auto-tagging, keyword extraction, BYOK support
Phase 6: Extensions πŸ“‹ Planned Chrome extension, PWA, web snapshots

See Product Requirements for detailed feature specifications.

Documentation

Contributing

Contributions are welcome! Please read our Development Guide first.

  1. Fork the repository
  2. Create a feature branch
  3. Make your changes
  4. Run tests and linting
  5. Submit a Pull Request

License

This project is licensed under the AGPL-3.0 License - see the LICENSE file for details.

About

A self-hosted RSS reader and personal knowledge management tool.

Topics

Resources

License

Stars

Watchers

Forks

Packages