STC DataHub adalah platform canggih untuk agregasi, normalisasi, dan visualisasi data pariwisata dari berbagai sumber. Dilengkapi dengan AI-powered insights, real-time collaboration, dan interactive visualizations yang membuat data tourism menjadi hidup!

• 🔄 Real-time Collaboration - Multi-user collaboration powered by SpacetimeDB
• 🤖 AI-Powered Insights - Smart recommendations & data quality analysis
• 🗺️ Interactive Maps - Leaflet-based geographic visualization with heatmaps
• 📊 Custom Dashboards - Drag-and-drop widget builder
• 🌐 Multi-language - Full i18n support (English & Indonesian)
• 🔗 REST API - Public API endpoints for data sharing
• 📦 7-Format Export - CSV, JSON, Excel, SQL, XML, NDJSON, Parquet

5-stage intelligent pipeline:

1. Fetch - Connect to real data sources (REST Countries, OpenStreetMap, Open Brewery)
2. Validate - Schema validation & data quality checks
3. Normalize - Intelligent field mapping & standardization
4. Enrich - Add metadata, geocoding, categorization
5. Store - Persist to database with versioning

• Interactive Maps - Pin-based geographic visualization with Leaflet
• Heatmap Analysis - Density visualization for tourism hotspots
• Charts & Graphs - Distribution, trends, and comparative analytics
• Before/After Preview - Data transformation showcases
• Real-time Feed - Live processing intelligence updates

• Multi-criteria Filtering - Search, category, country, price, rating filters
• Data Export - 7 formats with filtered data support
• AI Recommendations - Pattern detection & actionable insights
• Custom Dashboards - Personalized widget layouts
• Real-time Collaboration - See other users & live changes
• Public REST API - Share data via HTTP endpoints

Full UI translation in:

• 🇬🇧 English
• 🇮🇩 Bahasa Indonesia

• Node.js 18+
• npm/yarn/pnpm
• SpacetimeDB CLI (optional, for collaboration features)

# Clone repository
git clone https://github.com/yourusername/stc-datahub.git
cd stc-datahub

# Install dependencies
npm install

# Run development server
npm run dev

Open http://localhost:3000 🎉

For real-time collaboration features:

# Install SpacetimeDB CLI
curl --proto '=https' --tlsv1.2 -sSf https://install.spacetimedb.com | sh

# Start local SpacetimeDB server
spacetime start

# Publish module
cd spacetime-server
spacetime publish stc-datahub --clear-database

# Module will auto-connect from Next.js app

• API Documentation - REST API endpoints & usage
• Architecture Overview - Technical design & data flow
• Contributing Guide - How to contribute
• Deployment Guide - Production deployment

• Next.js 15 - React framework with App Router
• TypeScript - Type-safe development
• Tailwind CSS - Utility-first styling
• shadcn/ui - Component library
• Recharts - Data visualization
• Leaflet - Interactive maps
• react-grid-layout - Dashboard builder
• i18next - Internationalization

• SpacetimeDB - Real-time database & collaboration
• REST API - Data sharing endpoints
• Real Data Sources:
  • REST Countries API
  • OpenStreetMap Overpass API
  • Open Brewery DB

• Custom pattern detection engine
• Data quality analyzer
• Smart recommendations system

flowchart TD
    A["Register Source"] --> B["Fetch"]
    B --> C["Validate robots.txt & License"]
    C --> D["Normalize via Mapping Template"]
    D --> E["Enrich Web3 Fields (optional)"]
    E --> F["Store Raw + Normalized"]
    F --> G["Provenance Log"]
    G --> H["Preview & Download"]

flowchart TD
    A[👩‍💻 Users\nResearchers / Devs / Communities] --> B[📊 STC DataHub\nDiscover · Fetch · Normalize · Store]
    C[Kaggle\nGov Portals\ndata.go.id] --> B
    D[Garuda Kemdikbud\nAcademic Repos] --> B
    E[OpenStreetMap\nInsideAirbnb\nOther APIs] --> B
    B --> F[📈 Analytics & Insights\nDashboards, Reports]
    B --> G[🎓 Research & Education\nOpen Data for Academia]
    B --> H[🌐 Web3 Ecosystem\nSmart Contracts, dApps, NFT Tourism]

• Destination Discovery - Find and analyze tourism attractions
• Market Research - Compare destinations, pricing, ratings
• Data Standardization - Normalize disparate data sources

• Geographic Analysis - Heatmaps and spatial distributions
• Trend Analysis - Rating trends, pricing patterns
• Quality Control - Data completeness and accuracy checks

• Team Workflows - Real-time multi-user data processing
• Shared Insights - Collaborative analysis and annotations
• Live Updates - See changes as they happen

stc-datahub/
├── src/
│   ├── app/                    # Next.js App Router
│   │   ├── api/                # API routes
│   │   │   ├── data-share/     # Public data API
│   │   │   ├── stats/          # Statistics API
│   │   │   └── proxy/          # External API proxy
│   │   ├── layout.tsx          # Root layout
│   │   └── page.tsx            # Main dashboard
│   ├── components/
│   │   ├── dashboard/          # Dashboard components
│   │   ├── visualization/      # Charts, maps, heatmaps
│   │   ├── collaboration/      # Real-time features
│   │   └── ui/                 # shadcn/ui components
│   ├── lib/
│   │   ├── real-data-sources.ts      # API connectors
│   │   ├── data-export-utils.ts      # Export utilities
│   │   ├── ai-insights-engine.ts     # AI analysis
│   │   └── i18n.ts                   # Translations
│   ├── spacetime_module_bindings/    # SpacetimeDB client
│   └── hooks/                         # Custom React hooks
├── spacetime-server/
│   └── src/
│       └── lib.rs              # SpacetimeDB Rust module
├── public/                     # Static assets
└── docs/                       # Additional documentation

Fetch tourism data with filtering & pagination.

# Example
curl "http://localhost:3000/api/data-share?category=hotel&country=Indonesia&page=1&limit=10"

Get aggregated statistics.

curl "http://localhost:3000/api/stats"

See API_DOCS.md for complete documentation.

We welcome contributions! Please see CONTRIBUTING.md for guidelines.

1. Fork the repository
2. Create feature branch: git checkout -b feature/amazing-feature
3. Commit changes: git commit -m 'Add amazing feature'
4. Push to branch: git push origin feature/amazing-feature
5. Open Pull Request

This project is licensed under the MIT License - see the LICENSE file for details.

• SpacetimeDB - Real-time database infrastructure
• shadcn/ui - Beautiful component library
• Leaflet - Open-source mapping
• REST Countries - Country data API
• OpenStreetMap - Geographic data

• Issues: GitHub Issues
• Discussions: GitHub Discussions
• Email: [email protected]

• Additional data source connectors
• Machine learning model integration
• Advanced data transformation rules
• Team workspaces & permissions
• Mobile app (React Native)
• GraphQL API
• Data versioning & time travel
• Export scheduling & automation